Table of Contents

1. About DataShop
2. Getting Data In
   1. Data Logging
   2. Data Import
3. Accessing DataShop
4. Glossary
5. Reports
   1. Dataset Info
      1. Overview
      2. Papers and Files
      3. KC Models
      4. Problem Breakdown
   2. Learning Curve
      1. Examples
      2. Algorithm
      3. Student-Step Rollup
      4. LFA Values
   3. Error Report
   4. Performance Profiler
6. Filtering Data
   1. By student, KC, and problem
   2. Sample Selector
7. Export: Getting Data Out
   1. Export Format History
8. Using Other Tools
   1. R (software)
   2. Excel PivotTables
9. Advanced
   1. Web Services Credentials
      1. User Agreement
   2. Logging Activity
   3. Metrics
10. Examples
11. Contact Us

Data Import

In addition to logging data directly to the DataShop logging database, you can import data to create a new dataset in DataShop by sending us data in one of two forms:

• XML files that conform to the tutor_message DTD; or
• Tab-delimited text files that validate using our import file verification tool

You can also create new knowledge component models for existing datasets—see below.

• Importing XML files into DataShop
• Importing tab-delimited text files into DataShop
• Creating knowledge component models for existing datasets
• Logging new data

Importing XML files into DataShop

Before XML data can be imported into DataShop, you should first verify that the XML files you've created are well-formed and conform to the Tutor Message format version 2 or 4. The Tutor message format is a standardized format for logging tutor-related data. Validating your XML against this format ensures that your data can be properly stored and interpreted by DataShop.

DataShop provides a free, easy-to-use validation tool, the XML Validator Tool, for validating Tutor Message XML. We strongly encourage you to use this tool for validation.

After completing validation, email a zipped archive of the XML file(s) to datashop-help.

Importing tab-delimited text files into DataShop

DataShop can import a tab-delimited text file of transaction data similar to that generated by the DataShop export. The data import process is currently something that only DataShop staff can do.

You may want to import data as tab-delimited text to:

• create a smaller dataset from an existing one
• rename problems or steps
• clean up an existing dataset
• add data to DataShop without creating XML

To import tab-delimited text files, first verify that the text is valid by running it through our import file verification tool. Download the tool from our home page, and view the readme file which contains a description of how to run it, as well as a detailed explanation of import file requirements.

After running the tool and fixing any errors it reports, email a zipped archive of the tab-delimited text file(s) to datashop-help.

Creating knowledge component models for existing datasets

Use the “KC Models” page in DataShop to validate and import a new KC model. (Load the Dataset Info report and click the subtab “KC Models”.)

For more information on creating and modifying knowledge component models, see the page KC Models.

Logging new data

If you will be logging new data to DataShop, consider specifying knowledge component model information with each transaction. Some software, such as CTAT, will log knowledge component information for you if you associate knowledge components with steps. See "Data Logging" for a brief overview of logging. If you don't assign knowledge components ahead of time, you can also create a knowledge component model in DataShop after you've logged.

For more information on logging from your tutor or software, consult with your tutor developer or team, or contact us.