Data

As the portal platform of cloud GIS, SuperMap iPortal supports integrating traditional data, such as SuperMap GIS data, common GIS data and Excel, CSV files with geospatial coordinates, and also supports accessing big data, such as HDFS and HBase. Besides the GIS data, the non-GIS data (such as video, audio, image) can also be added to iPortal by using REST API. The data added to the portal can be used in built-in WebApps to use maps or various charts for visual expression and in-depth analysis.

• Upload data
• Register data
• Using the data added to iPortal

Upload data

To upload data in iPortal, the user must be the "CREATOR" type and has the role of uploading data and publishing service permissions, such as DATA_CENTER (the division of user type and permissions in iPortal, see: Role, User Type and Permissions). Also, the administrator needs to Specify hosting servers and Configure hosted data storage.

iPortal supports to configure binary and relational hosted data storage, and defaults to use binary storage. If both are configured, the system will give priority to relational storage and will also back up the uploaded data in binary storage. But there are still some data such as cached tiles only can be stored in the binary storage. Table 1 below shows the corresponding relationship of data type, data files, service type to publish and download format supported by the uploaded data.

Table 1: The corresponding relationship of data type, data files, service type to publish and download format supported by the uploaded data

¹ Represents the service type, or the download format is only supported when configuring the relational storage.

If you need to manage non-GIS data such as audio and video resources, you can upload it by using REST API. For details, see: The POST request of myDatas resource.

Additionally, iPortal has a size limit on the data capacity uploaded to iPortal. By default, the maximum capacity you can upload is 2048MB. The administrator can modify this configuration. For details, see: The uploaded data capacity configuration.

Upload steps:

1. On iPortal home page, click Resource Center > Data to enter the data resource page, click "Upload data" (needs login) to enter the data uploading page;

2. Select "Data Type", specify the "Data File" to upload, set the "Name" and "Tags", then click "Next";

3. Check the service type to publish, click "Upload and Publish", wait until the data uploading and publishing are finished, then the process is completed. Or you can also uncheck and directly click "Upload" to upload the data. When the uploading is finished, you can also perform publishing operations on Resource Center > Data > My Data page.

Note: If uploading Shapefile data, you also need to choose the file encoding format: UTF-8/GBK.

When uploading is finished, the system will automatically forward to the details page of the uploaded data item, you can view/edit related infos, download data, or switch to the "Sharing" tab to perform sharing operations. For details, see: Share data.

All of the uploaded data will be shown on the Resource Center > Data > My Data page. Besides the publish, edit, download, and share operations you can perform on the My Data page, the operations of update, delete, preview pdf data are also provided.

• If services have been published before the update operation, the services will be re-published when performing the update operation, while the service name will keep the same.
• If the data is deleted, the associated published service will also be deleted simultaneously. Note: If the data to be deleted has associated maps, insights, dashboards and other applications, the deletion operation will cause these associated resources to not be accessed normally. For more information about deletion, see: Delete resources.

Note:

 1 If the iPortal administrator enables the Service review function (disabled by default), after the data is published as services, the hosted services that automatically registered into iPortal will be in "Pending Review" state. The registration will succeed only when the administrator approves the review. To set sharing settings for a service to be reviewed or an unapproved service will not take effect. Users can check whether a service is approved or not by viewing the identification on the service thumbnail on "My Service" page. "Pending administrator review" shows the service in a "pending" state, while "Review Rejected" shows the administrator has rejected the review.

2 The data from adding a file, the point, line, or region data from adding a markerlayer in DataViz WebApp, and the data added in DataInsights WebApp, all of them will be saved in "My Data".

3: If the number of services you can publish has reached the upper limit, please contact your administrator to update the quota for you.

Register data

Registering data in iPortal also requires the user to be of the "CREATOR" type and has the role of uploading data and publishing service permissions, such as DATA_CENTER (the division of user type and permissions in iPortal, see: Role, User Type and Permissions). Also, the administrator needs to specify hosting servers. iPortal supports to register the following format data:

•  The CSV format data in Hadoop Distributed File System (HDFS)

•  The data in the distributed database -- Hadoop DataBase (HBase)

Register HDFS data:

1. On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:

2. Type: the type of data to register. Here select HDFS.
3. HDFS Data Path: fill in the HDFS path + CSV name, such as: hdfs://{ip}:9000/data/newyork_taxi_2013-01_14k.csv
4. Name: fill in the custom data name
5. Tags: fill in the custom tags for the data

2. Click "Register", the system will automatically parse and display the related configuration infos for the data, but you need to verify them manually:

3. X Index: the column corresponding to the X coordinate in the data
4. Y Index: the column corresponding to the Y coordinate in the data
5. EpsgCode: the EPSG code corresponding to the projected coordinate system of the data
6. Separator: the separator character in the CSV file
7. Whether include header: check according to whether the registered CSV data includes the table header

3. Click the "Verify" button to confirm the data configuration infos. If you can't confirm now, you can click "Verify Later". Later, you can also verify by clicking the button on the data item or on the details page.

Register HBase data:

1. On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:

2. Type: the type of data to register. Here select HBase
3. Service Address: fill in the HBase database service address
4. Database: fill in the name of the HBase database
5. Tags: fill in the custom tags for the data

2. Click "Register" to complete the HBase data registration process.

After registered successfully, the system will automatically forward to the details page of the data item, where you can view or edit related infos. To share the data, you can switch to the "Sharing" tab to perform. For details, see: Share data.

All of the registered data shows on the Resource Center > Data > My Data page. Note: The registered data doesn't occupy data storage capacity, and doesn't support publishing and downloading, only supports editing data details, sharing data, and deleting data operations.

Using the data added to iPortal

The GIS data added into the portal can be directly used in built-in WebApps to use maps or various charts for visual expression and in-depth analysis. Also, when the data is published as services, the services can be used in WebApps or called by other Web GIS applications. Specifically:

• In the DataViz Web App :

• 1. You can directly add Excel, CSV, GeoJSON or Shapefile data by Adding from file as a FeaturesLayer to overlap on the BaseLayer;
  2. Or, after published the data as a service, you can add the REST map service or REST data service as a layer;
  3. Now, you can use the data to make various thematic maps according to your needs.

• In the DataInsights Web App:

• 1. You can add the Excel, CSV, GeoJSON, Shapefile, or the registered HDFS, HBase data;
  2. Or, add the REST map service or REST data service by publishing the data;
  3. Now, you can use the added data or service to use maps or charts for visual expression; Furthermore, in the map view, you can use the provided analysis function to explore the law and value of the data.

Note: The added HDFS and HBase data only can be used for the distributed analysis function.

• In the iEarth Web App: You can add the published REST 3D service into the scene as a layer. And in the scene, you can Add point, line, or region features, or use measure, query, or perform analysis functions.

• In the MapDashboard Web App, the public data, my data, iServer REST service are supported as the datasource of the visual components. For details, see: Add visual components.

• In your Web GIS system, to call the services in iPortal, see: Use iCient JavaScript to call the resources of iPortal.