Create and publish data sets

Create a new data set

Create new data set

To create a new data set, follow this workflow as a logged in data manager or theme manager:

  1. Go to «Data» on the main toolbar
  2. Go to «Create new Data Set» at the bottom of the data set list
  3. Select a theme to link to your data set.
    • You can also create a data set without linking it to a theme, but without the link, you can’t publish services or execute transformation projects for that data set.
    • Superusers who belong to more than one organisation can select the organisation in which to create a dataset. The dropdown menu of available organisations enables Superusers to create datasets for organizations that they are not currently logged into.
  4. Select the data source. There are a few ways to upload the files belonging to your dataset:
    • Click «Select file(s)» and navigate to the desired dataset.
    • Click «Enter URL(s)» and navigate to the desired URL or WFS.
    • Drag a dataset to «Drop file(s) here»


    Tip: We recommend that you zip your files to reduce upload times and to ensure that no files are lost. To upload a Shapefile, you should zip all individual files (*.shp, *.dbf, *.prj, *.shx, …) in an archive. To upload an XML file such as ALKIS, ISYBAU or GML, we also recommend that you upload them as a zip archive.


    To upload your files from a database click «Connect to database» and enter the following information:

    • Database type (MS SQL, PostgreSQL and PostGIS are currently supported)
    • Host (:Port)
    • Database (Provide the database name)
    • Username
    • Password
  5. Give your data set a name. This name should enable you to quickly und clearly identify the data set in the system. If the linked theme’s metadata configuration is set up to use the name in publishing, the name is also used for data set metadata.
  6. Provide metadata for your data set. Metadata entry is determined by the theme associated with your dataset.

    If the theme uses the metadata editor, enter required and optional metadata for your dataset or services:

    • Metadata categories display a red badge with the number of missing required metadata elements. Click the chevron at the end of any metadata category to expand it.
    • Required input fields are marked by red symbols. Optional input fields are marked by orange symbols.
    • Metadata categories display a green check mark once you have provided all required metadata.
    • Click «Continue» to save the metadata.


    If the theme uses Republish existing metadata:

    • Upload your existing metadata file.

    If the theme uses Link to existing metadata:

    • Provide a link to your metadata file.
  7. In the final step, you can review all desired steps of the publishing and transformation process configured for the theme. By default, you will see up to five toggle switches to publish Download and View Services, to transform the new data set, and to publish services for the transformed data set. If you know you need to work on the data set before it is to be published, deactivate the service publishing.
If you close the browser or the tab, or you click a different link, you will be asked whether the work in progress data set should be saved or deleted. If you pick save, you can continue editing it later.

Create new data set with multiple resource types

hale»connect currently supports a range of file formats which can be used to create data sets. A data set may contain:

Vector data

  • Supported vector data formats include *.gml and *.shp
  • Multiple *.shp files can be uploaded to create a data set
  • Currently the upload of one *.gml file per data set is supported
    • INSPIRE, 3A, CityGML, XPlanung and ISYBAU are fully supported

Non-spatial data

  • Supported data formats include *.xml

Raster data

  • Supported formats include *.png, and *.GeoTIFF
  • Currently the upload of one raster data resource per data set is supported
  • A separate raster layer is published in the view and download services

Attachments

  • Supported file attachment formats include *.pdf, *.png, *.GeoTIFF, or even textures for 3D data
  • There are multiple ways to upload and associate attachments to your data set
  • Attachments uploaded during data set creation are added to the attachments section automatically
  • The attachment files uploaded to hale»connect have a publicly available link to the attachment file. The links to attachment files can be included in your Predefined data set download service. The links to attachment files and external URLs can also be viewed in the Feature Explorer Tool.
  • Separate service layers are not created for attachment files
  • Visit our help page for more information about working with attachments

A combination of these data resources

  • Data sets can include *.gml, raster and attachment data resources. View and download services for vector and raster data are published as separate layers.
  • Currently the upload of *.shp with combined data resources is not supported

To create a new data set with multiple resource types, follow this workflow as a logged in data manager or theme manager:

  1. Go to «Data» on the main toolbar
  2. Go to «Create new Data Set» at the bottom of the data set list
  3. Select a theme to link to your data set. The theme must be configured to allow additional layers from raster sources.
    • You can also create a data set without linking it to a theme, but without the link, you can’t publish services or execute transformation projects for that data set.
  4. Select the data sources. There are a few ways to upload the files belonging to your data set:
    • Click «Select file(s)» and navigate to the desired data set.
    • Click «Enter URL(s)» and navigate to the desired URL or WFS.
    • Drag a data set to «Drop file(s) here»


    Add a *.gml file, a raster file and as many associated attachment files as necessary.


    Tip: We recommend that you zip your files to reduce upload times and to ensure that no files are lost. To upload a *.png, you should zip all individual files (*.png, *.pgw, …) in an archive. To upload an XML file such as ALKIS, ISYBAU or GML, we also recommend that you upload them as a zip archive.

  5. Give your data set a name. This name should enable you to quickly und clearly identify the data set in the system. If the linked theme’s metadata configuration is set up to use the name in publishing, the name is also used for data set metadata.
  6. Provide metadata for your data set. Metadata entry is determined by the theme associated with your data set.

    If the theme uses the metadata editor, enter required and optional metadata for your data set or services:

    • Metadata categories display a red badge with the number of missing required metadata elements. Click the chevron at the end of any metadata category to expand it.
    • Required input fields are marked by red symbols. Optional input fields are marked by orange symbols.
    • Metadata categories display a green check mark once you have provided all required metadata.
    • Click «Continue» to save the metadata.


    If the theme uses Republish existing metadata:

    • Upload your existing metadata file.

    If the theme uses Link to existing metadata:

    • Provide a link to your metadata file.
  7. In the final step, you can review all desired steps of the publishing process configured for the theme. By default, you will see up to five toggle switches to publish Download and View Services, to transform the new data set, and to publish services for the transformed data set. If you know you need to work on the data set before it is to be published, deactivate the service publishing.
If you close the browser or the tab, or you click a different link, you will be asked whether the work in progress data set should be saved or deleted. If you pick save, you can continue editing it later.

Edit metadata

Edit metadata for a data set

Editing metadata can be a time-consuming and sometimes tiresome process. For this reason, the system allows automation of about 95% of the process. The remaining fields still have to be filled manually, or edited. Please keep the following hints in mind when manually editing metadata:

  • Your input has to be in the correct format. Some fields will allow any kind of text, while others expect numbers, web links, e-mail addresses, JSON objects or Well-Known-Text (WKT) objects. The round symbols to the left of each input indicate which type of input the system expects. When you hover over these symbols, you’ll get more information.
  • Some fields may be set more than once. To set multiple values, e.g. on «Keywords», click the «+» button below the input field. To remove a field again, click the remove symbol right next to the field.
  • When you edit metadata for any existing data set, each change is saved by the system as soon as you press enter or go to another field. The system indicates this by showing a green border and checkmark on the modified input.

To edit metadata, follow these steps:

  1. Go to «Data» on the main toolbar
  2. Pick the data set from the resource list for which you’d like to edit metadata
  3. Go to «Metadata»
  4. Enter required and optional metadata for your dataset or services. Open one of the metadata categories by clicking on the title or the chevron.
  5. Provide a value for any field marked with a red symbol. You can also edit existing values.
    • Red symbols turn green once required metadata has been entered, and the number of missing required metadata elements is updated in the category header.
  6. Close the category again and proceed with the next category

Publish services

Publish Services for a data set

You can publish view and download services if the theme linked to your data set has a valid service configuration. Publishing services is done either by triggering the automated publishing process at the end of the data set creation, or through a manual command later on. When you publish services, the system always creates all configured services types at once; in other words, if your theme configuration includes a view- and a download service, it is not possible to publish just a download service. The reason for this is that the metadata of each has references to the other.

When you’re logged in as a Data Manager or Theme manager, follow these steps to publish services manually:

  1. Go to «Data» on the main toolbar
  2. Pick the data set from the resource list for which you’d like to publish services
  3. Go to «View Services» or «Download Services»
  4. Activate the toggle switch
  5. Click «Publish services» to create and start the service, and also run any configured test suites
    • This process runs in the background and can take a while. A progress bar displaying the status of service creation, service testing and service publishing appears.
  6. As each process completes, additional information will become available:
    • Links to service and data set metadata
    • For view services, you’ll also get a preview link
    • Test reports
    • Service settings
    • Service log
  7. To unpublish a service, deactivate the toggle switch and click «Delete services».
Please note the following limitations of the current version:
  • Display properties configured for the theme are not used for the GetFeatureInfo in the WMS.
  • The ATOM Feed is not completely INSPIRE compliant, since elements for GeoRSS and Open Search are missing.