|Location:||Computer History Museum, Shoreline Drive, Mountain View, CA|
MarkLogic sponsored the first Big Data Workshop, an unconference on Big Data, led by Kaliya Hamilton, well-known unconference leader. The purpose of the unconference was to bring together people interested in and capable of addressing some of the big questions in this area.
Principal technologist, Jason Hunter, Community Director, Eric Bloch, and Trainer Nuno Job participated in several sessions and organized one on tools for Semi-structured data.
The conference's themes as described on the workshop's site were wide ranging:
- How will we manage all this information? Is the relational database doomed? How will we synchronize it? Will we all need to migrate to NoSQL stores? Or will the new play along nicely with 40 years of relational history?
- Who will manage this information? Will we all have to own our own massive infrastructure, will we rent it, or just call the APIs of somebody else?
- How will we analyze this information? Do we all need to learn Erlang and Map-Reduce, or will a new set of easy-to-use tools spring up, just like the spreadsheet came to the rescue a long time ago? Will programmers write code for distributed hash tables, relational databases, document stores, graph databases or all of the above?
- Who will we govern all that information? Who will keep it secure, and private, and audible? Who determines what can and cannot be correlated? Who will watch the watchmen?
The attendee list is available at Eventbrite and includes a variety of folks working in this space: leading open-source project committers, well-known hackers, commercial software vendors, IT professionals, Internet companies, and numerous other folks with lots of data.
Conference notes are available at the conference blog. The workshop organizers have also created a google group to support the self organization of people who attended the Big Data Workshop in April 2010 and those interested in participating in a community with them.