Create a New Harvesting Dataverse

You can create two types of harvesting dataverse:

  • OAI Harvesting Dataverse - This type of dataverse harvests data from OAI servers.
    Refer to Open Archives Initiative for information about OAI services.
  • Nesstar Harvesting Dataverse - This type of dataverse harvests data from Nesstar servers.
    Refer to Nesstar, owned by Norwegian Social Science Data Services (NSD), for information about Nesstar services.

When a dataverse harvests from another service, the first harvesting is a full harvest. For all other harvesting, an update is performed.

See the following topics for detailed information about how to create these dataverses:

Create a New OAI Harvesting Dataverse

To create a harvesting dataverse:

  1. Navigate to the Network homepage, and then click Network Options.
    You see the [Your] Dataverse Network Admin Options page.
  2. Scroll to the Dataverses, Harvesting, Exporting and OAI Sets options, and then click Create a New Harvesting Dataverse.
    You see the Harvest Dataverse page.
  3. In the Harvest Type field, click the OAI Server radio button.
  4. Enter a Name for the dataverse, which is displayed on the Network homepage.
  5. Enter an Alias, which is the short name for the dataverse used to build the site's URL.
    This field is case sensitive.
  6. Enter the Server URL for the network server from which you choose to harvest data, and then click the Validate button.
    If the server is valid, additional Harvesting fields are displayed for further configuration. If the server is not valid, the error message Please enter a valid url is displayed. Correct the server name, and then click Validate again.
    An example valid server is the IQSS DVN OAI server, http://dvn.iq.harvard.edu/dvn/OAIHandler.
  7. If harvesting sets are configured for the OAI server that you entered, then use the Harvesting Set pull-down list to select a valid set option.
    The default is No Set (harvest all).
  8. Use the Harvesting Format pull-down list to select the XML format to use in harvesting from that server.
    Possible values are DC (Dublin Core) and DDI, depending on the server's configuration.
  9. Use the Handle Registration pull-down list to select whether to register with HANDLE.NET any harvested studies that have these identifiers on the server from which you harvest them.
  10. You can enable harvesting on a scheduled basis, to refresh the contents of a harvest dataverse and keep it current with the server from which you harvest.
    To enable scheduled harvesting:

    1. Click the check box in the Schedule Harvesting field.
    2. Use the Scheduled Harvesting Period pull-down list to select Harvest daily or Harvest weekly.
      If you do not choose an option, there is no schedule applied to the harvesting function.
    3. If you choose Harvest daily, in the Scheduled Harvesting Hour of Day field set the time of day at which to perform the harvest.
    4. If you choose to Harvest weekly, in the Scheduled Harvesting Day of Week also set the day on which to perform the harvest.
  11. You can set permissions for all studies and files in the harvested dataverse to either Public or Restricted.
    To enable file permissions:

    1. Use the File Permissions pull-down list to make all study files in the harvested dataverse either Public or Restricted.
    2. If you choose to make files Restricted, use the Subset Permissions pull-down list to make subsetting of studies in the harvested dataverse either Public or Restricted.
    3. To enable specific users access to Restricted studies, enter a username in the field Allowed Users, if Files are Restricted, and then click the Add button.
      To remove access from a user, click the Remove User button beside that user's name in the Allowed Users field.
    4. To enable specific user groups access to Retricted studies, enter a group name in the field Allowed Groups, if Files are Restricted, and then click Add button.
      To remove access from a group, click the Remove Group button beside that group's name in the Allowed Groups field.
  12. Click Save or Cancel.
    If your save succeeds, the message Update Successful! is displayed.
    Click Network Options to return to the Network Admin Options page.

Note: Remember to release your harvesting dataverse to the public. See the Dataverse Admins Guide for information about releasing a dataverse.

Create a New Nesstar Harvesting Dataverse

To create a dataverse that harvests data from a Nesstar server:

  1. Navigate to the Network homepage, and then click Network Options.
    You see the [Your] Dataverse Network Admin Options page.
  2. Scroll to the Dataverses, Harvesting, Exporting and OAI Sets options, and then click Create a New Harvesting Dataverse.
    You see the Harvest Dataverse page.
  3. In the Harvest Type field, click the radio button for the Nesstar Server option.
  4. Enter a Name for the dataverse, which is displayed on the Network homepage.
  5. Enter an Alias, which is the short name for the dataverse used to build the site's URL.
    This field is case sensitive.
  6. Enter the Server URL for the Nesstar network server from which you choose to harvest data, and then click the Validate button.
    If the server is valid, additional Harvesting fields are displayed for further configuration. If the server is not valid, the error message Please enter a valid url is displayed. Correct the server name, and then click Validate again.
  7. Use the Harvesting Format pull-down list to select the XML format to use in harvesting from that server.
    The value DDI is available at this time.
  8. Use the Handle Registration pull-down list to select whether to register with HANDLE.NET any harvested studies that have these identifiers on the server from which you harvest them.
  9. You can set permissions for all studies and files in the harvested dataverse to either Public or Restricted.
    To enable file permissions:

    1. Use the File Permissions pull-down list to make all study files in the harvested dataverse either Public or Restricted.
    2. If you choose to make files Restricted, use the Subset Permissions pull-down list to make subsetting of studies in the harvested dataverse either Public or Restricted.
    3. To enable specific users access to Restricted studies, enter a username in the field Allowed Users, if Files are Restricted, and then click the Add button.
      To remove access from a user, click the Remove User button beside that user's name in the Allowed Users field.
    4. To enable specific user groups access to Retricted studies, enter a group name in the field Allowed Groups, if Files are Restricted, and then click Add button.
      To remove access from a group, click the Remove Group button beside that group's name in the Allowed Groups field.
  10. Click Save or Cancel.
    If your save succeeds, the message Update Successful! is displayed.
    Click Network Options to return to the Network Admin Options page.

Note: Remember to release your harvesting dataverse to the public. See the Dataverse Admins Guide for information about releasing a dataverse.