{"_id":"56e1d44dbc46be0e002af28e","__v":10,"category":{"_id":"56e1c96b2506700e00de6e83","version":"55faeacad0e22017005b8268","__v":38,"pages":["56e1ca17cd6a8d0e00d12163","56e1cb0fe416450e00b9e485","56e1cba3cd6a8d0e00d1216c","56e1cc1ae63f910e00e5986b","56e1d0b0cd6a8d0e00d1217f","56e1d15ce416450e00b9e4a3","56e1d23292bf640e00b55663","56e1d296bc46be0e002af287","56e1d305cd6a8d0e00d1218c","56e1d373e416450e00b9e4ab","56e1d38a92bf640e00b55669","56e1d44dbc46be0e002af28e","56e2cb174cd67e220032d655","56e2cf9c1067950e006a16c8","56e2d5ff3987d729008695a0","56e2ddea8ffe6020004c53b2","56e2df768ffe6020004c53bd","56e2e1201067950e006a16f1","56e2e3888ffe6020004c53c5","56e2e53f1067950e006a1702","56e2e9773987d729008695cf","56e2ec731bffb72b00d0562e","56e2ed25b9c88f2900864aab","56e2f0314cd67e220032d6b9","56e2f3c43987d729008695ed","56e2fc3fb9c88f2900864ad7","56e2fe0d3987d7290086960b","56e30180f1ad030e00e72fa7","56e302c228f99e2000a5ffa6","56e3040c6e602e0e00700af6","56e304c5d46bc30e007bb958","56e30650d46bc30e007bb965","56e307456e602e0e00700b08","56e3086251857d0e008e778d","56e3096251857d0e008e7796","56e30a16d46bc30e007bb973","56e30aafd46bc30e007bb97c","56e30aeb51857d0e008e779f"],"project":"55faeacad0e22017005b8265","sync":{"url":"","isSync":false},"reference":false,"createdAt":"2016-03-10T19:22:19.658Z","from_sync":false,"order":15,"slug":"read-query-vector-services-guide","title":"Read & Query Vector Services Guide"},"user":"56267741db1eda0d001c3dbb","version":{"_id":"55faeacad0e22017005b8268","project":"55faeacad0e22017005b8265","__v":34,"createdAt":"2015-09-17T16:31:06.800Z","releaseDate":"2015-09-17T16:31:06.800Z","categories":["55faeacbd0e22017005b8269","55faf550764f50210095078e","55faf5b5626c341700fd9e96","55faf8a7825d5f19001fa386","560052f91503430d007cc88f","560054f73aa0520d00da0b1a","56005aaf6932a00d00ba7c62","56005c273aa0520d00da0b3f","5601ae7681a9670d006d164d","5601ae926811d00d00ceb487","5601aeb064866b1900f4768d","5601aee850ee460d0002224c","5601afa02499c119000faf19","5601afd381a9670d006d1652","561d4c78281aec0d00eb27b6","561d588d8ca8b90d00210219","563a5f934cc3621900ac278c","5665c5763889610d0008a29e","566710a36819320d000c2e93","56ddf6df8a5ae10e008e3926","56e1c96b2506700e00de6e83","56e1ccc4e416450e00b9e48c","56e1ccdfe63f910e00e59870","56e1cd10bc46be0e002af26a","56e1cd21e416450e00b9e48e","56e3139a51857d0e008e77be","573b4f62ef164e2900a2b881","57c9d1335fd8ca0e006308ed","57e2bd9d1e7b7220000d7fa5","57f2b992ac30911900c7c2b6","58adb5c275df0f1b001ed59b","58c81b5c6dc7140f003c3c46","595412446ed4d9001b3e7b37","59e76ce41938310028037295"],"is_deprecated":false,"is_hidden":false,"is_beta":false,"is_stable":true,"codename":"v1","version_clean":"1.0.0","version":"1"},"parentDoc":null,"project":"55faeacad0e22017005b8265","updates":[],"next":{"pages":[],"description":""},"createdAt":"2016-03-10T20:08:45.939Z","link_external":false,"link_url":"","githubsync":"","sync_unique":"","hidden":false,"api":{"results":{"codes":[]},"settings":"","auth":"required","params":[],"url":""},"isReference":false,"order":1,"body":"| Table of Contents |\n| --- |\n| [Ingest Source Coverage and Refresh Schedule](#section-ingest-source-coverage-and-refresh-schedule) |\n| [Facets Query Vector Services Overview](#section-facets-query-vector-services-overview) |\n| [General Query Vector Services Overview](#section-general-query-vector-services-overview) |\n| [ESRI Query Vector Services Overview](#section-esri-query-vector-services-overview) |\n| [Shape Query Vector Services Overview](#section-shape-query-vector-services-overview) |\n| [Aggregations Query Vector Services Overview](#section-aggregations-query-vector-services-overview) |\n| [Index Query Vector Services Overview](#section-index-query-vector-services-overview) |\n| [Write Vector Services Overview](#section-write-vector-services-overview) |\n\n#Ingest Source Coverage and Refresh Schedule#\nBelow are the standard vector sources provided and information on update frequency.\n- ALCED - http://www.acleddata.com Africa coverage, static data\n- Anthrometer - Anomaly detection's within twitter data stream, Global coverage, updated every 15min\n- DG Catalog - DigitalGlobe image coverage footprints and metadata, Global coverage, updated daily\n- Gazetteer - https://www.usgs.gov/ & http://geonames.nga.mil/gns/html/index.html USGS & NGA GeoNames, Global coverage, data is static\n- GDELT - http://gdeltproject.org Global coverage, updated daily\n- HGIS 2.0 - https://www.digitalglobe.com/products/human-landscape Country level coverage (DG product, new countries and refreshes can be purchased), data is static, although we ingest new data if it is available.\n- ObjectDetection  - Results from on-demand processing within GBDX, results from users jobs are ingested and updated continuously\n- OSM - https://www.openstreetmap.org/ Global coverage, updated hourly\n- Road Tracker - Results from on-demand processing within GBDX, results from users jobs are ingested and updated continuously\n- RSS - ~30 news feeds, Global coverage, currently static data though can be turned on to live stream like twitter\n- Twitter - https://twitter.com Global coverage, updated real time\n- Note: We also have the ability for users to contribute their own vectors - that is by definition user dependent and irregularly updated.\n\n**Note:** Ingest Sources are subject to rapid change, and both the list of available sources as well as the vector count within each listed source may be different than the given examples. Basic principles still apply. \n\n#Facets Query Vector Services Overview#\nIn order for users to easily reference vector fields, facets are available. Users are able to query the available vector fields globally or within a specific area, and then set up queries within VectorServices to retrieve only the specified fields discovered within the facets.\n\nSee: [Vector Services Facets Reference Overview](doc:vector-services-facets-reference-overview).\n\nSee also:\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-facets-search-with-bounding-box) \n\n\n#General Query Vector Services Overview#\nThe VectorServices provides the analyst with a tool for visually mapping all available vectors within a given aoi. Analysts may then refine the resulting vectors into a desired selection. These quickly polled and returned arrays of points, linestrings, and polygons may then be used in further analytical studies of the area.\n\nThe general API endpoints work with any application.\n\nSee: [Vector Services General Reference Overview](doc:vector-services-general-reference-overview).\n\nSee also:\n- [Lesson: Vector Services General Searching](doc:lesson-vector-services-general-searching)\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-general-vector-services-with-bounding-box) \n\n\n#ESRI Query Vector Services Overview#\nIn order for users to easily utilize VectorServices in ESRI software, ESRI endpoints are available. These endpoints work best with ArcMap, and provide all of the functionality of the General Vector Services, quickly polling and returning arrays of points, polylines, and polygons that may then be used in further analytical studies of the area.\n\nSee: [Vector Services ESRI Reference Overview](doc:vector-services-esri-reference-overview).\n\nSee also:\n- [Lesson: Vector Services ESRI Searching](doc:lesson-vector-services-esri-searching)\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-esri-vector-services-with-bounding-box) \n\n\n#Shape Query Vector Services Overview#\nWhen the aoi that the user wants to work with is not a bounding box, VectorServices provides the ability to query over shape(s). These calls work with points, multi-points, linestrings, multi-linestrings, polygons, or multi-polygons, and provide the same functionality as the General Vector Services, quickly polling and returning arrays of points, polylines, and polygons that intersect the shape aoi(s), and that may then be used in further analytical studies of the area.\n\nThe Shape endpoints work in any application.\n\nSee: [Vector Services Shape Reference Overview](doc:vector-services-shape-reference-overview).\n\nSee also:\n- [Lesson: Vector Services Shape Searching](doc:lesson-vector-services-shape-searching)\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-general-vector-services-with-shape) \n\n\n#Aggregations Query Vector Services Overview#\nVectorServices provides aggregation capabilities to allow users to quickly and easily summarize data based on multiple parameters.  Data can be grouped by geohash, date/time, terms, and a number of other aggregation types.\n\nAggregations are useful for discovering relationships and differences among groups of data.  For example, a user could discover the most prolific Twitter users over a set of geohash boxes for the last week by aggregating tweet data by geohash region, time range, and the Twitter user name field.  Mixing different aggregation types will give users different views on their data, allowing them to discover relationships they might not have otherwise seen.\n\nSee: [Vector Services Aggregations Reference Overview](doc:vector-services-aggregations-reference-overview).\n\nSee also:\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-aggregations-with-bounding-box) \n\n\n#Index Query Vector Services Overview#\nWhen users know the indexes containing the items they want to query for or retrieve, VectorServices provides the ability to limit operations to specific vector indexes.  These calls avoid sending queries to the entire set of vectors, so they tend to take less time to process and return results.\n\nSee: [Vector Services Index Query Reference Overview](doc:vector-services-index-query-reference-overview).\n\nSee also:\n- [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-index-query-with-bounding-box) \n\n\n#Write Vector Services Overview#\nIn order for users to add a vector item or multiple vector items directly to an index, VectorServices provides user vector generation.  Vector generation is useful for direct additions of or updates to vectors, without needing a third party service or a vector submission request form.\n\nSee: [Vector Services Write Vectors Reference Overview](doc:vector-services-write-vectors-reference-overview).\n\nSee also:\n- [Ingesting Shapefiles via S3 Buckets](doc:ingesting-shapefiles-via-s3-buckets) \n- [Vector Services Elasticsearch Index Name Templates](doc:vs-elasticsearch-index-name-templates)","excerpt":"Introduction to the various parts of Vector Services","slug":"vector-services-course","type":"basic","title":"Vector Services Course"}

Vector Services Course

Introduction to the various parts of Vector Services

| Table of Contents | | --- | | [Ingest Source Coverage and Refresh Schedule](#section-ingest-source-coverage-and-refresh-schedule) | | [Facets Query Vector Services Overview](#section-facets-query-vector-services-overview) | | [General Query Vector Services Overview](#section-general-query-vector-services-overview) | | [ESRI Query Vector Services Overview](#section-esri-query-vector-services-overview) | | [Shape Query Vector Services Overview](#section-shape-query-vector-services-overview) | | [Aggregations Query Vector Services Overview](#section-aggregations-query-vector-services-overview) | | [Index Query Vector Services Overview](#section-index-query-vector-services-overview) | | [Write Vector Services Overview](#section-write-vector-services-overview) | #Ingest Source Coverage and Refresh Schedule# Below are the standard vector sources provided and information on update frequency. - ALCED - http://www.acleddata.com Africa coverage, static data - Anthrometer - Anomaly detection's within twitter data stream, Global coverage, updated every 15min - DG Catalog - DigitalGlobe image coverage footprints and metadata, Global coverage, updated daily - Gazetteer - https://www.usgs.gov/ & http://geonames.nga.mil/gns/html/index.html USGS & NGA GeoNames, Global coverage, data is static - GDELT - http://gdeltproject.org Global coverage, updated daily - HGIS 2.0 - https://www.digitalglobe.com/products/human-landscape Country level coverage (DG product, new countries and refreshes can be purchased), data is static, although we ingest new data if it is available. - ObjectDetection - Results from on-demand processing within GBDX, results from users jobs are ingested and updated continuously - OSM - https://www.openstreetmap.org/ Global coverage, updated hourly - Road Tracker - Results from on-demand processing within GBDX, results from users jobs are ingested and updated continuously - RSS - ~30 news feeds, Global coverage, currently static data though can be turned on to live stream like twitter - Twitter - https://twitter.com Global coverage, updated real time - Note: We also have the ability for users to contribute their own vectors - that is by definition user dependent and irregularly updated. **Note:** Ingest Sources are subject to rapid change, and both the list of available sources as well as the vector count within each listed source may be different than the given examples. Basic principles still apply. #Facets Query Vector Services Overview# In order for users to easily reference vector fields, facets are available. Users are able to query the available vector fields globally or within a specific area, and then set up queries within VectorServices to retrieve only the specified fields discovered within the facets. See: [Vector Services Facets Reference Overview](doc:vector-services-facets-reference-overview). See also: - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-facets-search-with-bounding-box) #General Query Vector Services Overview# The VectorServices provides the analyst with a tool for visually mapping all available vectors within a given aoi. Analysts may then refine the resulting vectors into a desired selection. These quickly polled and returned arrays of points, linestrings, and polygons may then be used in further analytical studies of the area. The general API endpoints work with any application. See: [Vector Services General Reference Overview](doc:vector-services-general-reference-overview). See also: - [Lesson: Vector Services General Searching](doc:lesson-vector-services-general-searching) - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-general-vector-services-with-bounding-box) #ESRI Query Vector Services Overview# In order for users to easily utilize VectorServices in ESRI software, ESRI endpoints are available. These endpoints work best with ArcMap, and provide all of the functionality of the General Vector Services, quickly polling and returning arrays of points, polylines, and polygons that may then be used in further analytical studies of the area. See: [Vector Services ESRI Reference Overview](doc:vector-services-esri-reference-overview). See also: - [Lesson: Vector Services ESRI Searching](doc:lesson-vector-services-esri-searching) - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-esri-vector-services-with-bounding-box) #Shape Query Vector Services Overview# When the aoi that the user wants to work with is not a bounding box, VectorServices provides the ability to query over shape(s). These calls work with points, multi-points, linestrings, multi-linestrings, polygons, or multi-polygons, and provide the same functionality as the General Vector Services, quickly polling and returning arrays of points, polylines, and polygons that intersect the shape aoi(s), and that may then be used in further analytical studies of the area. The Shape endpoints work in any application. See: [Vector Services Shape Reference Overview](doc:vector-services-shape-reference-overview). See also: - [Lesson: Vector Services Shape Searching](doc:lesson-vector-services-shape-searching) - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-general-vector-services-with-shape) #Aggregations Query Vector Services Overview# VectorServices provides aggregation capabilities to allow users to quickly and easily summarize data based on multiple parameters. Data can be grouped by geohash, date/time, terms, and a number of other aggregation types. Aggregations are useful for discovering relationships and differences among groups of data. For example, a user could discover the most prolific Twitter users over a set of geohash boxes for the last week by aggregating tweet data by geohash region, time range, and the Twitter user name field. Mixing different aggregation types will give users different views on their data, allowing them to discover relationships they might not have otherwise seen. See: [Vector Services Aggregations Reference Overview](doc:vector-services-aggregations-reference-overview). See also: - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-aggregations-with-bounding-box) #Index Query Vector Services Overview# When users know the indexes containing the items they want to query for or retrieve, VectorServices provides the ability to limit operations to specific vector indexes. These calls avoid sending queries to the entire set of vectors, so they tend to take less time to process and return results. See: [Vector Services Index Query Reference Overview](doc:vector-services-index-query-reference-overview). See also: - [Vector Services Example Query Constructions](doc:vector-services-example-query-constructions#section-index-query-with-bounding-box) #Write Vector Services Overview# In order for users to add a vector item or multiple vector items directly to an index, VectorServices provides user vector generation. Vector generation is useful for direct additions of or updates to vectors, without needing a third party service or a vector submission request form. See: [Vector Services Write Vectors Reference Overview](doc:vector-services-write-vectors-reference-overview). See also: - [Ingesting Shapefiles via S3 Buckets](doc:ingesting-shapefiles-via-s3-buckets) - [Vector Services Elasticsearch Index Name Templates](doc:vs-elasticsearch-index-name-templates)