UA-84229817-1

KRISTIAAN PELCKMANS

Some pointers to where real data can be delved from the web.

Time-series:

Economic: http://www.economicswebinstitute.org/ecdata.htm
Industrial: http://homes.esat.kuleuven.be/~smc/daisy/daisydata.html
TSDL: http://robjhyndman.com/TSDL/
gov data: yougov.se, yougov.co.uk, data.gov
EEG: http://sccn.ucsd.edu/~arno/fam2data/publicly_available_EEG_data.html
Mike West: http://www.stat.duke.edu/~mw/ts_data_sets.html
UWO: http://www.stats.uwo.ca/faculty/aim/epubs/datasets/default.htm

Data mining:

MLdata: http://mldata.org/
Duke: http://www.stat.duke.edu/~mw/ts_data_sets.html
UCI data: http://archive.ics.uci.edu/ml/index.html
MLDATA: http://mldata.org/
INEX: http://inex.otago.ac.nz/, http://webspam.lip6.fr/
PASCAL: http://pascallin2.ecs.soton.ac.uk/Challenges/
Clopinet: http://clopinet.com/challenges/
KD nuggets: http://www.kdnuggets.com/datasets/competitions.html
Delicious: http://www.delicious.com/pskomoroch/dataset, http://www.datawrangling.com/some-datasets-available-on-the-web
Datamob: http://datamob.org
Ranking: http://learningtorankchallenge.yahoo.com/, http://research.microsoft.com/en-us/projects/mslr/
ed.ac.uk: http://www.inf.ed.ac.uk/teaching/courses/dme/html/datasets0405.html
Million Song: http://labrosa.ee.columbia.edu/millionsong/
Nokia: http://research.nokia.com/mdc
Yandex: http://imat-relpred.yandex.ru/en
biomed: http://datam.i2r.a-star.edu.sg/datasets/krbd/
Kaggle: http://www.kaggle.com/
Mindboggle: http://mindboggle.info/index.html
CAMrA: http://2011.camrachallenge.com/
Statistical Machine Translation: http://www.statmt.org/
ENRON email dataset: https://www.cs.cmu.edu/~./enron
Movielens: https://www.researchgate.net/publication/305682388_Mise-en-Scene_Dataset_Stylistic_Visual_Features_of_Movie_Trailers_description
Youtube dataset: http://netsg.cs.sfu.ca/youtubedata/, https://research.googleblog.com/2016/09/announcing-youtube-8m-large-and-diverse.html
Images: http://homepages.inf.ed.ac.uk/rbf/CVonline/Imagedbase.htm

Big data:

Single datasets and data repositories

Agriculture

U.S. Department of Agriculture's PLANTS Database

Biology

Climate/Weather

Complex Networks

Computer Networks

Data Challenges

Economics

Energy

Finance

GeoSpace/GIS

Government
Healthcare

Image Processing

Machine Learning

Museums

Natural Language

Physics

Public Domains
Search Engines

Social Sciences
Sports

Time Series

Transportation

Complementary Collections

DataWrangling: Some Datasets Available on the Web
Inside-r: Finding Data on the Internet
Quora: Where can I find large datasets open to the public?
RS.io: 100+ Interesting Data Sets for Statistics
StaTrek: Leveraging open data to understand urban lives
OpenDataMonitor: An overview of available open data resources in Europe

copy pasta … TBprocessed:

• Big data sets available for free

BioMed:

Statlib: http://lib.stat.cmu.edu/datasets/
StatSci: http://www.statsci.org/datasets.html
Klein-book: http://www.mcw.edu/biostatistics/Faculty/Faculty/JohnPKleinPhD/SurvivalAnalysisBook/DataSetsBothEditions.htm
PhysioMed: http://physionet.caregroup.harvard.edu/physiobank/database/
PhysioNet: http://www.physionet.org/challenge/
GLIMs: http://www.sci.usq.edu.au/staff/dunn/Datasets/tech-glms.html
NeuroVault: http://neurovault.org/
OpenfMRI: https://openfmri.org/

Software:

CVX: http://cvxr.com/cvx/
Tfocs: http://tfocs.stanford.edu/
Mosek: http://www.mosek.com/
Shogun: http://www.shogun-toolbox.org/
Weka: http://www.cs.waikato.ac.nz/ml/weka/
Mahout: http://mahout.apache.org/
Google SensorFlow: https://www.tensorflow.org/
IBM DataWorks: http://www.ibm.com/analytics/us/en/watson-dataworks-project/
MS: https://azure.microsoft.com/en-us/services/machine-learning/

ML Networks:

NERF: http://www.nerf.be/
Kurzweil: http://www.kurzweilai.net/
Sciencemag: http://www.sciencemag.org/site/feature/data/compsci/machine_learning.xhtml
PASCAL: http://www.pascal-network.org/

Blogs:

Hunch: http://hunch.net/
Nuit Blanche: http://nuit-blanche.blogspot.se/
My Biased Coin: http://mybiasedcoin.blogspot.se/
Mark Reid’s: http://mark.reid.name/
InherentUncertainty: http://www.inherentuncertainty.org/