User talk:Bdcousineau
DPLA ~ send in the bots: new section
← Older revision
Revision as of 04:07, 26 March 2013
Line 673:
Line 673:
:[[w:Linked data]] isn't new (it's existed for a while in different models such as [[w:relational database]]s, but it's gaining ground today, especially with [[w:Big Data]] and affordable processing. (Some Big Brother concerns have been raised with various public/private entities linking Big Data to form predictive profiles). The cost should primarily be with the generation of the linked data...unless you're doing something fancy and need uber-expensive Oracle licenses. The processing of the data shouldn't be the primary factor unless you have a really really massive dataset. As I stated when we first started, once you get the data organized, you can do whatever you want.[[User:Smallman12q|Smallman12q]] ([[User talk:Smallman12q|talk]]) 01:41, 26 March 2013 (UTC)
:[[w:Linked data]] isn't new (it's existed for a while in different models such as [[w:relational database]]s, but it's gaining ground today, especially with [[w:Big Data]] and affordable processing. (Some Big Brother concerns have been raised with various public/private entities linking Big Data to form predictive profiles). The cost should primarily be with the generation of the linked data...unless you're doing something fancy and need uber-expensive Oracle licenses. The processing of the data shouldn't be the primary factor unless you have a really really massive dataset. As I stated when we first started, once you get the data organized, you can do whatever you want.[[User:Smallman12q|Smallman12q]] ([[User talk:Smallman12q|talk]]) 01:41, 26 March 2013 (UTC)
::Not really related, but NASA suspended its [http://ntrs.nasa.gov/ NASA Technical Reports Server (NTRS)] [http://www.informationweek.com/security/government/nasa-tightens-security-in-response-to-in/240151412 ][http://www.nytimes.com/2013/03/23/us/nasa-shuts-down-database-during-security-inquiry.html ] which contained 1 million+ files (and I had planned to [[Commons:Batch uploading/Nasa Technical Reports Server (NTRS)|upload]] at some point). Most GLAM institutions don't have to worry about sensitive material....but you should be aware that once out, you can't put it back, especially since open data is often mirrored/used in various ways.[[User:Smallman12q|Smallman12q]] ([[User talk:Smallman12q|talk]]) 02:08, 26 March 2013 (UTC)
::Not really related, but NASA suspended its [http://ntrs.nasa.gov/ NASA Technical Reports Server (NTRS)] [http://www.informationweek.com/security/government/nasa-tightens-security-in-response-to-in/240151412 ][http://www.nytimes.com/2013/03/23/us/nasa-shuts-down-database-during-security-inquiry.html ] which contained 1 million+ files (and I had planned to [[Commons:Batch uploading/Nasa Technical Reports Server (NTRS)|upload]] at some point). Most GLAM institutions don't have to worry about sensitive material....but you should be aware that once out, you can't put it back, especially since open data is often mirrored/used in various ways.[[User:Smallman12q|Smallman12q]] ([[User talk:Smallman12q|talk]]) 02:08, 26 March 2013 (UTC)
+
+
== DPLA ~ send in the bots ==
+
+
Here is a plan where we make a [[w:Neuromancer]]-like run at some of that metadata.
+
Assuming the metadata structure is organized appropriately, then:
+
*only download images from Presidential Libraries
+
*do it at the time of the DPLA launch 12:01 am April 20 (be the first big data dump from DPLA to Commons),
+
*get DPLA invloved so you can peek at the metadata before hand to make sure of the structuring (use Sarah S.'s new role as OpenGLAM rep to arrange this with Emily at DPLA-I emailed her about this too)
+
*get a few bots invloved
+
*write press releases six ways to sunday: DPLA is happy that Wikipedia is their first customer, OpenGLAM gets all the credit, Wikipedians flock to DPLA
+
*I get to live in a Gibson novel like I've wanted since '84.
+
+
Any interest? What's missing? [[User:Bdcousineau|Bdcousineau]] ([[User talk:Bdcousineau#top|talk]]) 04:07, 26 March 2013 (UTC)
http://commons.wikimedia.org/w/index.php?title=User_talk:Bdcousineau&diff=93288488&oldid=93285584