Big Data Sets

source
http://www.quora.com/Where-can-I-find-large-datasets-open-to-the-public



Cross-disciplinary data repositories, data collections and data search engines:

• http://usgovxml.com
• http://aws.amazon.com/datasets
• http://databib.org
• http://datacite.org
• http://figshare.com
• http://linkeddata.org
• http://reddit.com/r/datasets
• http://thedatahub.org alias http://ckan.net
• http://quandl.com
• Social Network Analysis Interactive Dataset Library (Social Network Datasets)
• Datasets for Data Mining
• http://enigma.io

Single datasets and data repositories

http://archive.ics.uci.edu/ml/
http://crawdad.org/
http://data.austintexas.gov
http://data.cityofchicago.org
http://data.govloop.com
http://data.gov.uk/
data.gov.in
http://data.medicare.gov
http://data.seattle.gov
http://data.sfgov.org
http://data.sunlightlabs.com
https://datamarket.azure.com/
http://developer.yahoo.com/geo/g...
http://econ.worldbank.org/datasets
http://en.wikipedia.org/wiki/Wik...
http://factfinder.census.gov/ser...
http://ftp.ncbi.nih.gov/
http://gettingpastgo.socrata.com
http://googleresearch.blogspot.c...
http://books.google.com/ngrams/
http://medihal.archives-ouvertes.fr
http://public.resource.org/
http://rechercheisidore.fr
http://snap.stanford.edu/data/in...
http://timetric.com/public-data/
https://wist.echo.nasa.gov/~wist...
http://www2.jpl.nasa.gov/srtm
http://www.archives.gov/research...
http://www.bls.gov/
http://www.crunchbase.com/
http://www.dartmouthatlas.org/
http://www.data.gov/
http://www.datakc.org
http://dbpedia.org
http://www.delicious.com/jbaldwi...
http://www.faa.gov/data_research/
http://www.factual.com/
http://research.stlouisfed.org/f... 
http://www.freebase.com/
http://www.google.com/publicdata...
http://www.guardian.co.uk/news/d...
http://www.infochimps.com
http://www.kaggle.com/
http://build.kiva.org/
http://www.nationalarchives.gov....
http://www.nyc.gov/html/datamine...
http://www.ordnancesurvey.co.uk/...
http://www.philwhln.com/how-to-g...
http://www.imdb.com/interfaces
http://imat-relpred.yandex.ru/en...
http://www.dados.gov.pt/pt/catal...
http://knoema.com
http://daten.berlin.de/
http://www.qunb.com
http://databib.org/
http://datacite.org/
http://data.reegle.info/
http://data.wien.gv.at/
http://data.gov.bc.ca
https://pslcdatashop.web.cmu.edu/ (interaction data in learning environments)
http://www.icpsr.umich.edu/icpsrweb/CPES/ - Collaborative Psychiatric Epidemiology Surveys: (A collection of three national surveys focused on each of the major ethnic groups to study psychiatric illnesses and health services use)
http://www.dati.gov.it
http://dati.trentino.it

Mobile cloud sync

http://sourceforge.net/projects/funambol/files/bundle/v10/

http://www.openmobster.com

Html5 data sync: offline online

http://www.ibm.com/developerworks/library/wa-html5db/index.html
https://github.com/orbitaloop/WebSqlSync

http://www.j-io.org
http://diveintohtml5.info/storage.html
http://www.deardorffdigital.com/articles/html5-web-storage
http://www.html5rocks.com/en/features/storage
https://github.com/coresmart/persistencejs

http://blog.oxfordcc.co.uk/backbone-local-storage-and-server-synchronization/

Java Sync Framework

http://www.symmetricds.org/about/overview

http://www.manageability.org/blog/stuff/java-open-source-replication-synchronization/view

Compare Image

http://stackoverflow.com/questions/1460239/library-that-identifies-similar-images

http://www.pureftpd.org/project/libpuzzle
http://appsrv.cse.cuhk.edu.hk/~jkzhu/felib.html


http://mindmeat.blogspot.sg/2008/11/java-image-comparison.html
http://mindmeat.blogspot.sg/2008/07/java-image-comparison.html


http://www.lac.inpe.br/JIPCookbook/6050-howto-compareimages.jsp#howtohowdoicomparetwoimagestoseeiftheyareequalaverysimplealgorithmtocompareimagesforipossibleisimilaritywithoutconsideringthehighlevelcontents

html5 form validation

http://ericleads.com/h5validate/

http://parsleyjs.org

Zorba: NoSQL Query Processing

http://www.zorba.io/home

Dynamic Reporting

http://www.developer.com/java/doing-dynamic-reporting-through-jasperreport.html?dni=144043881&rni=7219120

http://dynamicjasper.com/project-info/

How to set TransformerFactory

http://stackoverflow.com/questions/11314604/how-to-set-saxon-as-the-xslt-processor-in-java

NB Classloader

http://bits.netbeans.org/dev/javadoc/org-openide-modules/org/openide/modules/doc-files/classpath.html#syscl

XMLBeans compiling with schema dependencies

 http://wiki.apache.org/xmlbeans/XmlBeansFaq#schemaDependencies