Module 03 · Packages, APIs, Data Sets, and Models
Additional Sources of Datasets更多数据集来源
Reading: Additional Sources of Datasets 阅读:数据集的其他来源
Estimated time: 5 mins 预计时间:5 分钟
In this reading, you will learn about:
在本阅读中,您将学习:
- Open datasets and sources
开放数据集和来源 - Proprietary datasets and sources
专有数据集和来源 - Dataset license 数据集许可证
Open datasets and sources 开放数据集和来源
In this data-driven world, some datasets are freely available for anyone to access, use, modify, and share. These are called open datasets.
在这个数据驱动型世界中,某些数据集可以免费供任何人访问、使用、修改和分享。这些被称为开放数据集。
Open datasets include a public license and are very useful for your journey as a Data Scientist. Some of the most informative open dataset sources are listed below.
开放数据集包含公共许可证,对于数据科学家来说非常有用。以下列出了一些最有信息量的开放数据集来源。
Government Data: 政府数据:
- https://www.data.gov/
- https://www.census.gov/data.html
- https://data.gov.uk/
- https://www.opendatanetwork.com/
- https://data.un.org/
Financial Data Sources: 金融数据来源:
- https://data.worldbank.org/
- https://www.globalfinancialdata.com/
- https://comtrade.un.org/
- https://www.nber.org/
- https://fred.stlouisfed.org/
Crime Data: 犯罪数据:
- https://www.fbi.gov/services/cjis/ucr
- https://www.icpsr.umich.edu/icpsrweb/content/NACJD/index.html
- https://www.drugabuse.gov/related-topics/trends-statistics
- https://www.unodc.org/unodc/en/data-and-analysis/
Health Data: 健康数据:
- https://www.who.int/gho/database/en/
- https://www.fda.gov/Food/default.htm
- https://seer.cancer.gov/faststats/selections.php?series=cancer
- https://www.opensciencedatacloud.org/
- https://pds.nasa.gov/
- https://earthdata.nasa.gov/
- https://www.sgim.org/communities/research/dataset-compendium/public-datasets-topic-grid
Academic and Business Data:
学术与商业数据:
- https://scholar.google.com/
- https://nces.ed.gov/
- https://www.glassdoor.com/research/
- https://www.yelp.com/dataset
Other General Data: 其他通用数据:
Propriety datasets and sources 专有数据集和来源
Proprietary datasets contain data primarily owned and controlled by specific individuals or organizations. This data is limited in distribution because it is sold with a licensing agreement.
专有数据集包含主要由特定个人或组织拥有和控制的数据。由于这些数据随许可协议出售,因此其分发受到限制。
Some data from private sources cannot be easily disclosed, like public data.
来自私人来源的一些数据无法像公共数据那样轻易披露。
National security data, geological, geophysical, and biological data are examples of propriety data. Copyright laws or patents usually bind this type of data. Proprietary datasets that mainly contain sensitive information are less widely available than open datasets.
国家安全数据、地质数据、地球物理数据和生物数据是专有数据的例子。版权法或专利通常约束这类数据。主要包含敏感信息的专有数据集比开放数据集的可用性较低。
Some standard propriety dataset sources are listed below.
以下列出了某些标准的专有数据集来源。
Health Care: 医疗保健:
https://www.sgim.org/communities/research/dataset-compendium/proprietary-datasets
Financial Market data: 金融市场数据:
https://datarade.ai/data-categories/proprietary-market-data
Google Cloud based datasets:
基于 Google Cloud 的数据集:
https://cloud.google.com/datasets
Dataset licenses 数据集许可
When you select a dataset, it is necessary to look into the license. A license explains whether you can use that dataset or not; or explains if you have to accept certain guidelines to use that dataset. The different license types are listed below.
当您选择一个数据集时,需要查看其许可。许可说明您是否可以使用该数据集,或者说明您是否需要接受某些使用指南才能使用该数据集。不同的许可类型如下所列。
- PUBLIC DOMAIN MARK - PUBLIC DOMAIN
公共领域标记 - 公共领域
When a dataset has a Public Domain license, all the rights to use, access, modify and share the dataset are open to everyone. Here there is technically no license.
当数据集具有公共领域许可时,使用、访问、修改和共享数据集的所有权利都对所有人开放。这里在技术上没有许可。 - OPEN DATA COMMONS PUBLIC DOMAIN DEDICATION AND LICENSE – PDDL
OPEN DATA COMMONS PUBLIC DOMAIN 赠与和许可 – PDDL
Open Data Commons license has the same features as the Public Domain license, but the difference is the PDDL license uses a licensing mechanism to give the rights to the dataset.
开放数据公共许可与公共领域许可具有相同的特点,但不同之处在于PDDL 许可使用许可机制来赋予数据集的权利。 - CREATIVE COMMONS ATTRIBUTION 4.0 INTERNATIONAL CC-BY
This license allows users to share and modify a dataset, but only if they give credit to the creator(s) of the dataset.
此许可允许用户共享和修改数据集,但前提是他们必须向数据集的创建者(们)致谢。 - COMMUNITY DATA LICENSE AGREEMENT – CDLA PERMISSIVE-2.0
社区数据许可协议 – CDLA 许可-2.0
Like most open-source licenses, this license allows users to use, modify, adapt, and share the dataset, but only if a disclaimer of warranties and liability is also included.
与大多数开源许可类似,此许可允许用户使用、修改、适应和共享数据集,但前提是必须包含免责声明和责任限制。 - OPEN DATA COMMONS ATTRIBUTION LICENSE - ODC-BY
开放数据共同署名许可 - ODC-BY
This license allows users to share and adapt a dataset, but only if they give credit to the creator(s) of the dataset.
这项许可允许用户共享和改编数据集,但前提是他们必须向数据集的创建者(们)致谢。 - CREATIVE COMMONS ATTRIBUTION-SHAREALIKE 4.0 INTERNATIONAL - CC-BY-SA
知识共享署名-相同方式共享 4.0 国际许可协议 - CC-BY-SA
This license allows users to use, share, and adapt a dataset, but only if they give credit to the dataset and show any changes or transformations, they made to the dataset. Users might not want to use this license because they have to share the work they did on the dataset.
这项许可允许用户使用、共享和改编数据集,但前提是他们必须向数据集致谢,并展示他们对数据集所做的任何更改或转换。用户可能不希望使用这项许可,因为他们必须共享他们在数据集上所做的工作。 - COMMUNITY DATA LICENSE AGREEMENT – CDLA-SHARING-1.0
社区数据许可协议 – CDLA-SHARING-1.0
This license uses the principle of ‘copyleft’: users can use, modify, and adapt a dataset, but only if they don’t add license restrictions on the new work(s) they create with the dataset.
本许可采用“Copyleft”原则:用户可以使用、修改和适配数据集,但前提是他们不得在新作品中添加许可限制。 - OPEN DATA COMMONS OPEN DATABASE LICENSE - ODC-ODBL
OPEN DATA COMMONS 开放数据库许可 - ODC-ODBL
This license allows users to use, share, and adapt a dataset but only if they give credit to the dataset and show any changes or transformations they make to the dataset. Users might not want to use this license because they have to share the work they did on the dataset.
本许可允许用户使用、共享和适配数据集,但前提是他们必须注明数据集的出处,并展示他们对数据集所做的任何更改或转换。用户可能不希望使用此许可,因为他们必须共享他们在数据集上完成的工作。 - CREATIVE COMMONS ATTRIBUTION-NONCOMMERCIAL 4.0 INTERNATIONAL - CC BY-NC
This license is a restrictive license. Users can share and adapt a dataset, provided they give credit to its creator(s) and ensure that the dataset is not used for any commercial purpose.
这项许可是一种限制性许可。用户可以共享和改编数据集,前提是他们必须注明创作者的姓名,并确保该数据集不用于任何商业目的。 - CREATIVE COMMONS ATTRIBUTION-NO DERIVATIVES 4.0 INTERNATIONAL - CC BY-ND
CREATIVE COMMONS署名-禁止演绎 4.0 国际版 - CC BY-ND
This license is also a restrictive license. Users can share a dataset if they give credit to its creator(s). This license does not allow additions, transformations, or changes to the dataset.
这项许可也是一种限制性许可。用户可以共享数据集,前提是他们必须注明创作者的姓名。这项许可不允许对数据集进行任何添加、转换或修改。 - CREATIVE COMMONS ATTRIBUTION-NONCOMMERCIAL-SHAREALIKE 4.0 INTERNATIONAL - CC BY-NC-SA
CREATIVE COMMONS 署名-非商业性使用-相同方式共享 4.0 国际版 - CC BY-NC-SA
This license allows users to share a dataset only if they give credit to its creator(s). Users can share additions, transformations, or changes to the dataset, but they cannot use the dataset for commercial purposes.
此许可允许用户在归功于其创作者的情况下共享数据集。用户可以共享数据集的补充、转换或更改,但不得将其用于商业目的。 - CREATIVE COMMONS ATTRIBUTION-NONCOMMERCIAL-NODERIVATIVES 4.0 INTERNATIONAL - CC BY-NC-ND
CREATIVE COMMONS 署名-非商业性使用-禁止演绎 4.0 国际版 - CC BY-NC-ND
This license allows users to share a dataset only if they give credit to its creator(s). Users are not allowed to modify the dataset and are not allowed to use it for commercial purposes.
此许可允许用户在归功于其创作者的情况下共享数据集。用户不得修改数据集,也不得将其用于商业目的。
Note: Additional license types exist. Any dataset you use will include details about its license.
注意:存在其他类型的许可。您使用的任何数据集都将包含其许可的详细信息。