数据采集与分析
University of Edinburgh:INF2-FDS — Foundations of Data Science
Section titled “University of Edinburgh:INF2-FDS — Foundations of Data Science”- [1]D. Sterratt and K. Gal, “Foundations of Data Science (Inf2-FDS) Lecture Notes.” The University of Edinburgh, Jan. 19, 2026. Accessed: Oct. 31, 2026. [PDF]. Available: https://opencourse.inf.ed.ac.uk/archives/25-26/sites/default/files/2026-01/FDS-lecture-notes-2026-01-19.pdf其它链接:免费资源:
- Lecture notes (19 January 2026, PDF) (CC BY-SA (version not specified))
- [2]“Informatics 2 – Foundations of Data Science: Labs.” The University of Edinburgh. Accessed: Oct. 31, 2026. [Jupyter notebooks and PDF]. Available: https://opencourse.inf.ed.ac.uk/archives/25-26/node/549.html其它链接:免费资源:
- Getting started
- Semester 1 labs
- Week 1: Introduction to Jupyter notebooks and Pandas
- Week 2: Data wrangling I
- Week 3: Visualisation for exploratory data analysis
- Week 4: Visualisation for data communication
- Week 5: Data wrangling II
- Week 5: Data wrangling II — published solution
- Week 7: Linear models
- Week 8: Principal components analysis
- Week 9: k-nearest neighbours
- Week 10: K-means
- Semester 2 labs
- Supplementary lab
- [3]“Informatics 2 – Foundations of Data Science: Workshops.” The University of Edinburgh. Accessed: Oct. 31, 2026. [HTML and PDF]. Available: https://opencourse.inf.ed.ac.uk/archives/25-26/node/554.html免费资源:
- Semester 1 workshops
- Semester 2 workshops
- Handouts
这里列出常用数据集的主要目的并不是建议大家使用这些数据集完成课外项目。相反,从 GitHub 可以很容易搜索到大量使用这些数据集的仓库,因此我希望大家尽量避免直接使用它们,而是自己去不同的领域发现需求、收集并清洗数据。
- [4]A. Go, R. Bhayani, and L. Huang, “Sentiment140.” Accessed: Nov. 02, 2026. [CSV]. Available: https://www.kaggle.com/datasets/kazanova/sentiment140
- [5]CrowdFlower, “Twitter US Airline Sentiment.” Figure Eight, Oct. 16, 2019. Accessed: Nov. 03, 2026. [CSV and SQLite]. Available: https://www.kaggle.com/datasets/crowdflower/twitter-airline-sentiment免费资源:
- Dataset files (CSV and SQLite, ZIP) (CC-BY-NC-SA-4.0)
- [6]GroupLens Research, “MovieLens.” GroupLens Research. Accessed: Nov. 03, 2026. [CSV and text]. Available: https://grouplens.org/datasets/movielens/机构:
- University of Minnesota
免费资源:- MovieLens 32M
- Dataset (CSV, ZIP) (GroupLens research-use terms; commercial use requires permission)
- Data dictionary, usage terms and citation instructions
- MovieLens 20M
- Dataset (CSV, ZIP) (GroupLens research-use terms; commercial use requires permission)
- Data dictionary, usage terms and citation instructions
- MovieLens 100K
- Dataset (text, ZIP) (GroupLens research-use terms; commercial use requires permission)
- Data dictionary, usage terms and citation instructions
- [7]“MIND: MIcrosoft News Dataset.” Microsoft Research. Accessed: Nov. 03, 2026. [TSV]. Available: https://msnews.github.io/免费资源:
- MIND Large and Small: maintained download mirror (Microsoft Research License Terms)
- MIND Small training set (ZIP) (Microsoft Research License Terms)
- MIND Small validation set (ZIP) (Microsoft Research License Terms)
- Dataset license terms
- [8]J. McAuley and J. Leskovec, “Social circles: Facebook.” in Stanford Large Network Dataset Collection. Accessed: Nov. 02, 2026. [Text edge lists and node features]. Available: https://snap.stanford.edu/data/ego-Facebook.html
- [9]“Reddit.” in GraphSAGE. Accessed: Nov. 03, 2026. [JSON, NumPy and text]. Available: https://snap.stanford.edu/graphsage/#datasets
- [10]“Protein-Protein Interactions.” in GraphSAGE. Accessed: Nov. 03, 2026. [JSON, NumPy and text]. Available: https://snap.stanford.edu/graphsage/#datasets
- [11]W. W. Zachary, “Zachary’s Karate Club.” Accessed: Nov. 02, 2026. [Graph and GML]. Available: https://networkx.org/documentation/stable/reference/generated/networkx.generators.social.karate_club_graph.html
- [12]Y. LeCun, C. Cortes, and C. J. C. Burges, “The MNIST database of handwritten digits.” Accessed: Nov. 03, 2026. [IDX]. Available: https://www.tensorflow.org/datasets/catalog/mnist其它链接:
- Original dataset URL (Currently an empty directory listing.)
- Creator metadata: Wolfram Data Repository
- TensorFlow Datasets citation and CVDF mirror definitions
- [13]“diamonds.” in ggplot2. Accessed: Nov. 02, 2026. [R data and CSV]. Available: https://ggplot2.tidyverse.org/reference/diamonds.html
- [14]“TLC Trip Record Data.” New York City Taxi and Limousine Commission. Accessed: Nov. 02, 2026. [Parquet and CSV]. Available: https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
数据库分析性能基准与数据生成工具
Section titled “数据库分析性能基准与数据生成工具”- [15]Transaction Processing Performance Council, TPC Benchmark H (Decision Support): Standard Specification, TPC-H, San Francisco., Apr. 28, 2022. Accessed: Nov. 02, 2026. [Online]. Available: https://www.tpc.org/tpch/
- [16]Transaction Processing Performance Council, TPC Benchmark DS: Standard Specification, TPC-DS, Nov. 21, 2024. Accessed: Nov. 02, 2026. [Online]. Available: https://www.tpc.org/tpcds/
- [17]“Sample datasets,” Microsoft Learn. Accessed: Nov. 03, 2026. [Online]. Available: https://learn.microsoft.com/en-us/azure/databricks/discover/databricks-datasets
- [18]“Azure Open Datasets,” Microsoft Learn. Accessed: Nov. 03, 2026. [Online]. Available: https://learn.microsoft.com/en-us/azure/open-datasets/dataset-catalog