Meta tags:

Headings (most frequently used words):

data, and, the, csv, in, open, for, to, of, with, from, at, on, csvs, web, wikipedia, keynote, public, work, building, can, is, conversion, as, free, knowledge, using, spreadsheets, one, documents, richard, smith, ben, schedule, conf, creative, source, science, by, registers, authoritative, lists, you, trust, dynamic, driven, stenci, la, hangout, time, speakers, who, more, information, easy, massive, scale, reuse, scientific, outputs, this, not, map, interactive, maps, themes, curious, geometries, there, back, again, automatic, detection, logical, table, structures, master, dataset, approaches, publishing, bidirectional, nested, json, rinse, repeat, what, we, learn, xlsx, describing, image, collections, without, any, staff, democratising, financial, times, distributing, dat, serving, browser, donations, wikidata, how, get, your, into, base, life, death, decisions, powered, grimoires, demonology, databases, wordpress, hackers, trying, stay, relevant, linked, structured, journalism, bbc, packages, frictionless, research, fighting, against, chaotically, separated, values, embulk, bigchaindb, blockchain, database, decentralized, world, computer, tools, google, gotta, catch, em, all, recognizing, sloppy, crowdsourcing, tasks, making, part, comma, chameleon, desktop, editor, week, together, share, explore, jupyter, notebooks, catmandu, toolkit, increasing, access, under, ressourced, languages, visualizations, d3, js, through, hoop, got, 99, problems, was, ons, databaker, pretty, useful, notsobig, crunching, referrer, logs, mapping, unmappable, creating, transit, megacity, lunch, break, jenny, bryan, sarah, gold, jeremy, freeman, zara, rahman, unna, aurelia, moser, till, doehmen, jones, webb, mathieu, jacomy, brian, scott, renton, matt, chadburn, karissa, mckelvey, foxall, jens, ohlig, serah, njambi, mouse, reeve, jure, triglav, adam, white, basile, simon, dan, fowler, sadayuki, furuhashi, greg, mcmullen, thomas, steiner, maciej, gryka, jeni, tennison, stuart, harrison, micheleen, harris, johann, rolschewski, lucie, aime, kaffee, princiya, marina, sebastian, komianos, michaela, benyohai, philip, potter, darren, barnes, joe, wass, oliver, buchtala, mohamed, hegazy, michael, aufreiter, v2, statistics, professor, university, british, columbia, takes, special, delight, analysis, computing, designer, interested, interaction, networks, domain, she, founder, company, if, neuroscientist, hhmi, janelia, working, binder, lightning, researcher, writer, activist, whose, focuses, bridging, gap, between, activists, technologists, see, full, list, community, those, love, big, small, made, possible, following, generous, sponsors, presenters, breakfast, outros, goodbye, coffee, 6pm, check, out, v1, location, tuesday, wednesday, organizers,

Text of the page (most frequently used words):
the (200), and (172), data (127), for (71), csv (48), this (42), with (38), open (32), from (31), that (29), are (23), can (23), room (22), web (21), how (19), will (18), watch (18), have (18), tool (18), video (17), #wikipedia (16), you (16), using (16), all (15), talk (15), conf (14), use (14), into (14), work (14), like (14), spreadsheets (14), tools (13), our (13), see (12), #access (12), its (12), about (12), gallery (12), format (12), has (12), which (11), knowledge (11), https (11), public (11), more (10), information (10), http (10), these (10), csvs (10), through (10), building (10), their (10), github (9), any (9), com (9), one (9), also (9), them (9), free (9), make (9), they (9), keynote (9), share (9), google (9), based (8), not (8), break (8), other (8), who (8), users (8), process (8), database (8), linked (8), maps (8), visualizations (8), your (8), well (8), creative (7), time (7), want (7), built (7), source (7), but (7), get (7), excel (7), application (7), what (7), working (7), browser (7), json (7), under (6), was (6), between (6), internet (6), people (6), org (6), easy (6), together (6), way (6), map (6), world (6), present (6), software (6), community (6), decentralized (6), interactive (6), part (6), node (6), end (6), content (6), api (6), would (6), out (5), documents (5), dat (5), digital (5), library (5), spreadsheet (5), science (5), most (5), languages (5), used (5), there (5), available (5), wikidata (5), create (5), collection (5), while (5), challenges (5), structures (5), dataset (5), gov (5), back (5), conversion (5), driven (5), been (5), massive (5), may (5), structured (5), journalism (5), catmandu (5), some (5), explore (5), reuse (5), government (5), approach (5), javascript (5), large (5), jupyter (5), notebooks (5), system (5), registers (5), 2016 (5), filtering (5), rinse (5), repeat (5), ben (5), images (4), international (4), scientific (4), standards (4), environment (4), code (4), where (4), simple (4), collaboration (4), stencila (4), show (4), give (4), www (4), help (4), comma (4), chameleon (4), possible (4), major (4), around (4), problems (4), analysis (4), non (4), service (4), services (4), logical (4), common (4), formats (4), files (4), news (4), relevant (4), features (4), interface (4), machine (4), useful (4), research (4), both (4), than (4), because (4), power (4), look (4), platform (4), trust (4), crowdsourcing (4), learn (4), file (4), smith (4), often (4), then (4), nested (4), standard (4), distributing (4), richard (4), wordpress (4), collections (4), scale (4), berlin (4), conference (4), here (3), license (3), list (3), dan (3), fowler (3), attendees (3), read (3), hangout (3), live (3), easily (3), shared (3), language (3), provide (3), few (3), speakers (3), same (3), project (3), many (3), making (3), wiki (3), increasing (3), publication (3), wrong (3), desktop (3), editor (3), creation (3), even (3), better (3), year (3), statistics (3), organisations (3), serving (3), 000 (3), megacity (3), developing (3), citizens (3), mapping (3), creating (3), tabular (3), comes (3), automatic (3), detection (3), table (3), canonical (3), when (3), again (3), suite (3), take (3), life (3), death (3), decisions (3), kenya (3), gap (3), dynamic (3), stenci (3), bbc (3), now (3), full (3), today (3), trying (3), stay (3), hackers (3), such (3), development (3), specific (3), toolkit (3), traditional (3), pretty (3), called (3), databaker (3), package (3), allows (3), ons (3), bigchaindb (3), had (3), blockchain (3), without (3), central (3), themes (3), very (3), sharing (3), schedule (3), good (3), programming (3), learning (3), just (3), running (3), grimoires (3), books (3), early (3), problem (3), offer (3), behind (3), processing (3), quality (3), chaotically (3), donations (3), upload (3), technical (3), integrity (3), datasets (3), authoritative (3), lists (3), sloppy (3), xlsx (3), high (3), bidirectional (3), small (3), master (3), nuclear (3), rest (3), university (3), record (3), outputs (3), text (2), released (2), html (2), design (2), turn (2), forked (2), template (2), presentation (2), talks (2), over (2), spectrum (2), including (2), query (2), testing (2), w3c (2), profit (2), following (2), collaborative (2), function (2), python (2), complex (2), updated (2), anyone (2), substance (2), foundation (2), jure (2), triglav (2), barriers (2), makes (2), kind (2), topics (2), only (2), covered (2), don (2), reach (2), lucie (2), aime (2), kaffee (2), ressourced (2), really (2), benefits (2), job (2), mind (2), bit (2), call (2), publish (2), along (2), taking (2), why (2), putting (2), stuart (2), harrison (2), week (2), order (2), basketball (2), europe (2), improve (2), try (2), formatted (2), sebastian (2), komianos (2), hoop (2), got (2), cairo (2), transportation (2), africa (2), health (2), transport (2), provides (2), describe (2), capture (2), real (2), mohamed (2), hegazy (2), unmappable (2), transit (2), decided (2), variables (2), long (2), itself (2), two (2), automatically (2), convert (2), aim (2), till (2), doehmen (2), apps (2), issues (2), communities (2), serah (2), njambi (2), powered (2), bridging (2), coders (2), accessible (2), key (2), allowing (2), oliver (2), buchtala (2), michael (2), aufreiter (2), labs (2), years (2), core (2), model (2), facts (2), basile (2), simon (2), youtube (2), jeremy (2), freeman (2), lunch (2), modules (2), storage (2), records (2), domain (2), johann (2), rolschewski (2), office (2), scraper (2), converting (2), sheet (2), effectively (2), robust (2), overview (2), output (2), engage (2), wider (2), darren (2), barnes (2), instance (2), projects (2), dream (2), enough (2), greg (2), mcmullen (2), computer (2), meaning (2), representation (2), custom (2), basemaps (2), off (2), human (2), historical (2), yet (2), aurelia (2), moser (2), curious (2), geometries (2), joe (2), wass (2), notsobig (2), crunching (2), referrer (2), logs (2), ever (2), significant (2), packaging (2), user (2), packages (2), frictionless (2), jenny (2), bryan (2), sarah (2), gold (2), place (2), libraries (2), front (2), server (2), generate (2), interact (2), princiya (2), marina (2), magical (2), made (2), context (2), whole (2), lot (2), mouse (2), reeve (2), demonology (2), databases (2), opinions (2), going (2), garbage (2), systems (2), quick (2), collaborating (2), cleaning (2), hopefully (2), micheleen (2), harris (2), offered (2), within (2), online (2), whose (2), created (2), thomas (2), steiner (2), 2015 (2), matt (2), chadburn (2), democratising (2), financial (2), times (2), plugin (2), sadayuki (2), furuhashi (2), fighting (2), against (2), separated (2), values (2), embulk (2), find (2), discussion (2), jens (2), ohlig (2), base (2), blog (2), register (2), country (2), twitter (2), michaela (2), benyohai (2), philip (2), potter (2), solve (2), maciej (2), gryka (2), gotta (2), catch (2), recognizing (2), tasks (2), past (2), left (2), brian (2), interaction (2), could (2), jeni (2), tennison (2), zara (2), rahman (2), sciences (2), however (2), interesting (2), since (2), refine (2), visualization (2), capabilities (2), different (2), filter (2), mathieu (2), jacomy (2), flat (2), flatten (2), webb (2), network (2), bandwidth (2), uptime (2), those (2), karissa (2), mckelvey (2), websites (2), ends (2), enable (2), reactor (2), jones (2), approaches (2), publishing (2), new (2), adam (2), white (2), special (2), luna (2), workflow (2), various (2), macro (2), runs (2), need (2), run (2), scott (2), renton (2), describing (2), image (2), staff (2), unna (2), foxall (2), kalkscheune (2), germany (2), love (2), makers (2), ticket (2), dec (2), css, reused, mit, fork, site, martini, peoplesopen, net, commons, attribution, view, speaker, summaries, coverage, slides, videos, lanyrd, first, held, 2014, hosted, upcoming, check, announcement, poster, sticker, sponsorship, prospectus, barratt, max, ogden, martin, fenner, datacite, karthik, ram, ropensci, elaine, wong, cbc, john, chodacki, california, event, organized, unpaid, volunteers, organizers, questions, contact, coord, googlegroups, dot, csvconference, strives, supportive, welcoming, encourage, enforcing, conduct, 6pm, outros, goodbye, coffee, app, each, cell, coko, biggest, accessing, tend, hard, issue, widely, internationally, speak, potentially, vital, multilingual, mediawiki, extension, articleplaceholder, team, willing, interns, put, helps, compliant, validate, led, talking, earlier, started, scrapping, analysing, anywhere, advanced, competitions, teams, players, agents, fans, understanding, happening, games, demonstrate, pitfalls, beginner, ran, existent, weirdly, sparse, architecture, million, inhabitants, km2, area, metro, lines, 4529, buses, registered, microbuses, estimated, unregistered, taxis, little, informal, dominates, provision, intense, competition, limited, urban, road, space, leads, chronic, congestion, countries, negatively, impacting, climate, safe, clean, affordable, opportunities, goods, amenities, city, awaiting, limitations, existing, complexity, plethora, shapes, flavors, structure, publisher, wide, columns, variable, name, column, entry, mixtures, identifiers, categories, observations, methods, overall, reduce, amount, janitorial, currently, required, ingesting, evaluate, scraped, quack, doctors, concern, medical, practitioners, board, partnership, largest, blue, collar, newspaper, impact, starhealth, clickers, reproducibility, true, interfaces, pushing, aggregator, concepts, fledged, functionalities, production, quotes, articles, answer, lie, x1boqjxlv2a, ease, import, retrieval, export, transformation, meta, combine, frameworks, document, stores, mongodb, indexes, elasticsearch, rapid, after, short, introduction, command, line, cli, dsl, last, national, hooked, produce, too, spread, much, readable, usable, freely, wrapper, xypath, produced, baker, recipes, extract, flexible, brief, moving, forward, adding, uris, fields, hope, interest, adapting, always, knew, ethereum, ipfs, chance, contribution, fully, discuss, organization, cohesive, administer, authority, potential, across, disciplines, remarkably, varied, spatial, geo, topography, linking, tables, foreign, datatype, remarkable, multivariate, beaten, geographic, projection, designed, published, cemetery, burial, plots, galactic, drawings, star, wars, universe, sequence, genes, heatmaps, court, traffic, during, nba, finals, artisanal, vehicle, innovation, geocoding, handmade, investigate, interactives, detailing, unmapped, might, perfect, expression, friction, acquisition, researchers, decade, surrounding, identified, subproblem, tractable, adoption, lightweight, specification, associated, tooling, transporting, efficiently, another, titled, close, analogy, containerization, shipping, breakfast, wednesday, still, considered, popular, choice, addons, dynamically, objects, written, loaded, require, were, ordinary, module, primarily, framework, comprises, added, necessary, leverage, manipulating, sets, showing, beautiful, spells, invocations, appear, 3rd, century, thriving, genre, renaissance, enlightenment, hierarchy, hell, descriptions, demons, formulas, results, mundane, warm, bath, extraordinary, raising, dead, describes, exploring, algorithms, graph, old, fashioned, looks, before, anything, important, happens, second, analytics, forecasting, recommendations, avoid, dreaded, scenario, easiest, colleagues, playing, specifically, writing, lately, scratch, pad, exploration, graphical, importantly, others, play, logic, method, demo, notebook, aimed, pre, peek, introduce, drive, edit, realtime, encyclopedia, among, means, facilitates, tomayac, permissive, apache, rebuilt, house, mission, democratise, transformed, oblique, warehouse, infrequently, understood, stream, wanted, usability, guessing, schema, edited, humans, machines, acts, wikimedia, sister, institutions, unesco, museums, curate, craft, uploads, apart, side, things, navigate, pages, gds, gdstechnology, guaranteeing, blogs, fco, guestpost, spreading, word, names, gdsteam, status, 697818739547336704, initiative, mechanism, guarantee, proofs, authenticity, know, dealing, workers, effort, come, elbow, grease, bonus, properly, persist, models, serve, predictions, ins, outs, diff, render, independently, tried, tackling, ideas, worth, considering, warts, best, imagine, suited, relied, personal, reality, social, humanities, tweets, scholars, analyze, noisy, necessity, monitoring, uneasy, poor, tableau, basic, addition, graphic, efficient, paris, médialab, meet, tackle, minimal, iterate, keeping, eye, nutshell, represented, array, spawning, synchronize, functions, accepts, leveraging, efficiency, scientists, shortcut, fry, famous, acquire, parse, mine, represent, honored, repository, medialab, defined, defining, everyone, finds, consume, contracting, 360giving, taken, hybrid, involves, representations, opendataservices, centralized, expensive, difficult, maintain, instead, drastically, increase, ensure, connecting, download, peers, already, versioned, distribute, via, workshop, leave, superior, ensuring, search, visualisation, costly, consuming, build, least, management, managing, niche, understand, creates, publicising, visual, ways, cottage, cottagelabs, patchwork, borrowed, stitched, enhanced, bridge, keep, manage, cover, transformations, generalised, visualisations, economical, couple, examples, wild, sparc, sparcopen, oaspectrum, association, figures, aspx, integrated, release, later, globally, mean, quarter, likes, bill, market, w3techs, suddenly, unprecedented, own, goals, client, educate, third, parties, edinburgh, proud, resolution, wealth, holds, discovery, handled, imaging, supplied, jp2k, zooming, presents, metadata, solr, indices, getting, presented, number, briefly, photographers, receive, readers, orders, items, found, manuscripts, recorded, worksheets, move, reasons, happened, shorthand, techniques, renames, embed, identification, tiffs, per, generated, parses, particular, covers, gives, skeleton, cataloguers, devoted, enrich, searchable, purpose, lamp, technologies, allow, crowd, further, catalogue, hived, correct, xml, processes, grown, organically, does, everything, heart, literature, optimised, components, lessons, learned, highlight, pain, points, guide, curation, efforts, browsers, powerful, requesting, displaying, though, reading, capability, right, advantages, doing, rather, script, ones, future, tuesday, johannisstr, 10117, venue, location, presenters, generous, sponsors, isn, curating, advancing, art, producing, meaningful, insight, distributed, cluster, big, folks, passionate, society, should, join, bring, doers, backgrounds, industry, stories, researcher, writer, activist, focuses, activists, technologists, neuroscientist, lightning, binder, hhmi, janelia, designer, interested, networks, she, founder, company, professor, british, columbia, takes, delight, computing, above, earthquake, noaa, rendering, thanks, coming, portland, pay, bird, april, 15th, everywhere, featuring, brightest, minds, wayback, archive, 20221223033927, csvconf, timestamps, fail, success, 2023, 2022, 2021, jan, nov, 2026, captures,

Text of the page (random words):
development process and highlight pain points that can guide data creation and curation efforts 10 30 00 describing image collections without any staff room 4 scott renton the university of edinburgh s library and university collections is very proud of its high resolution images of the wealth of special collections it holds the discovery of these images is handled by the luna imaging platform a supplied system which allows high quality jp2k zooming and also presents its metadata using robust solr indices getting the data into the application has presented us with a number of interesting challenges to briefly describe this workflow our photographers receive readers orders from items they have found in our manuscripts and these are recorded using excel worksheets we have offered to move the whole process to the web but for various reasons this has not happened we take the shorthand data that they record and turn it into presentation standard using an excel macro which features various programming techniques this macro also runs file renames and runs a process to embed identification data into the tiffs from here per collection csvs are generated for upload to the system which parses the particular csv into the relevant format under the covers this gives us a skeleton record in the luna system as we do not have cataloguers devoted to our images we need to be creative to enrich the records to make them searchable we have built a purpose built crowdsourcing application based on standard lamp technologies to allow the crowd to further catalogue the record the data is then hived off to the correct standard using json or xml and run back in using processes we ve built around the system s rest api this end to end workflow has grown organically does everything we need it to do and has csv at its very heart watch video 11 00 00 wordpress as data gallery k adam white over the past two years we have been building a new json based rest api for wordpress available today as a plugin that api could be integrated into a core wordpress release as early as later this year and with the reach wp has globally that would mean a quarter of the internet as wp likes to bill its market share see w3techs would suddenly have unprecedented access to their own content in a structured data format i want to share the goals we have had while working on the wp api project and its client libraries and to open a discussion about how to educate users that they will have access to their data in this way and that third parties may as well 11 00 00 csv as the master dataset and approaches to web publishing room 4 richard jones websites which provide search and data analysis visualisation capabilities to end users can be costly and time consuming to build not least because custom back ends for data management are often complex small organisations managing niche datasets understand and use spreadsheets well but this creates barriers to publicising their information in visual and interactive ways at cottage labs http cottagelabs com we re working on a patchwork of open source tools borrowed stitched together or enhanced to bridge that gap and enable these organisations to keep and manage their master data as csvs or any other sheet format they like then to get it online and into their websites to engage their communities this talk will cover the common challenges both technical and human the data transformations and the generalised approach to visualisations that makes this process quick and economical we ll show a couple of examples in the wild including sparc s http sparcopen org open access spectrum http oaspectrum org and the world nuclear association s http www world nuclear org reactor database http www world nuclear org information library facts and figures reactor database aspx 11 30 00 distributing open data with dat gallery karissa mckelvey distributing data with a centralized server can often be expensive and difficult to maintain if we instead use a decentralized or flat network we can drastically increase bandwidth and ensure uptime by connecting those who download data with peers who already have it dat is a data tool for distributing datasets small and large attendees will learn how to create a versioned data package with dat and distribute it via an open network this workshop will leave attendees with a superior tool for ensuring integrity uptime and bandwidth for open data 11 30 00 bidirectional conversion to from csv for nested json data room 1 ben webb a well defined nested format like json can be useful for defining a data standard however not everyone finds it easy to publish and consume json for the open contracting and 360giving data standards we ve taken the hybrid approach of a canonical json representation with bidirectional conversion to from spreadsheets since this involves converting between nested and flat representations we ve called our software flatten tool https github com opendataservices flatten tool 11 30 00 csv rinse repeat room 4 mathieu jacomy csv is a common data format in social sciences and digital humanities for instance a list of tweets that scholars want to analyze however the most interesting data is often the most noisy filtering the content of a csv is a necessity but monitoring the process is an uneasy process since cleaning tools like open refine have poor visualization capabilities and tools like tableau public are basic at filtering in addition no graphic interface is more efficient at filtering than a programming language like javascript at sciences po paris médialab we often meet this problem and have decided to tackle it by developing a free and open source tool csv rinse repeat is a minimal web interface allowing you to upload a csv and then iterate through filtering while keeping an eye on different visualizations in a nutshell you can filter the data represented as a javascript array while spawning simple d3 visualizations that synchronize with the output of your filtering csv rinse repeat functions well with twitter data but accepts any kind of csv by leveraging the efficiency of javascript and d3 js data scientists can shortcut ben fry s famous data visualization process acquire parse filter mine represent refine interact we would be honored to present our tool and to share how we use it to explore large csv data github repository https github com medialab csv rinse repeat watch video 12 00 00 lunch break 12 30 00 keynote keynote zara rahman 13 30 00 making csv part of the web gallery jeni tennison imagine csv was a format suited to the web just as html is we would see high quality data because it would be relied on for user interaction we would see reuse of data because it could be linked that was my personal aim working on the w3c csv on the web standards i ll talk about the standards features and the work left to do to make that dream a reality watch video 13 30 00 what we can learn from xlsx room 1 brian smith for the past year i ve been learning the ins and outs of the excel file format in order to diff excel spreadsheets render them in the browser and convert them into other file formats like csvs the excel file format has been around for a long time and has independently tried to solve many of the same problems the open data community is tackling now for this talk i ll give an overview of how xlsx files work the good ideas it has worth considering as well as the warts best left behind 13 30 00 gotta catch em all recognizing sloppy work in crowdsourcing tasks room 4 maciej gryka if you have ever used crowdsourcing you know that dealing with sloppy workers is a major part of the effort come see this talk if you want to learn about how to solve this problem using machine learning and some elbow grease as a bonus you will also find out how to properly persist your ml models and use them to serve predictions through an http api watch video 14 00 00 registers authoritative lists you can trust gallery michaela benyohai philip potter we are developing software for registers an initiative from the government digital service to improve the trust services and citizens can place in government data building a mechanism to guarantee the integrity of these canonical tabular datasets on the web through the use of digital proofs of authenticity https twitter com gdsteam status 697818739547336704 https country register gov uk http blogs fco gov uk guestpost 2016 02 11 spreading the word and data on country names https gdstechnology blog gov uk 2015 10 13 guaranteeing the integrity of a register https gds blog gov uk s registers watch video 14 00 00 data donations for wikidata how to get your data into the free knowledge base room 1 jens ohlig wikidata is a free linked database that can be read and edited by both humans and machines it acts as central storage for the structured data of its wikimedia sister projects such as wikipedia in this talk we ll see how large data donations from institutions like unesco or museums can find their way into wikidata how to curate data for upload and craft code for specific uploads apart from the technical side of things we ll look at the community behind it all and how to navigate through discussion pages 14 00 00 fighting against chaotically separated values with embulk room 4 sadayuki furuhashi we created a plugin based data collection tool that can read any chaotically formatted files called csv by guessing its schema automatically watch video 14 30 00 break break 15 00 00 democratising data at the financial times gallery matt chadburn hi in 2015 the ft rebuilt it s in house data platform with a mission to democratise access to it s data i ll share about how we transformed an oblique data warehouse infrequently updated and understood by a few into a stream of real time information accessible to anyone who wanted to use it this talk is about the usability of data through it s collection to systems used to model access and query it watch video 15 00 00 wikipedia tools for google spreadsheets room 1 thomas steiner in this talk we introduce the wikipedia tools for google spreadsheets google spreadsheets is part of a free web based software office suite offered by google within its google drive service it allows users to create and edit spreadsheets online while collaborating with other users in realtime wikipedia is a free access free content internet encyclopedia whose content and data is available among other means through an api with the wikipedia tools for google spreadsheets we have created a toolkit that facilitates working with wikipedia data from within a spreadsheet context we make these tools available as open source on github https github com tomayac wikipedia tools for google spreadsheets released under the permissive apache 2 0 license 15 00 00 work together share and explore data in jupyter notebooks room 4 micheleen harris we all like to see what our data looks like before anything important happens we also like second opinions is it going to be good enough for analytics like forecasting or recommendations how do we avoid the dreaded garbage in garbage out scenario what s the easiest way to get my colleagues to take a look i ve been playing in jupyter notebooks systems specifically writing r code a lot lately i use jupyter for a scratch pad testing environment quick data exploration tool with all the graphical power r has to offer and most importantly i share these notebooks with others so they may play and explore as well as offer their opinions i m going to offer some logic behind collaborating with this simple yet interactive method of using jupyter notebooks i will also demo a notebook system running r aimed at pre processing and cleaning data as well as taking a peek at its quality hopefully we can work together 15 30 00 grimoires demonology and databases gallery mouse reeve grimoires books of spells and magical invocations appear in europe as early as the 3rd century and made up a thriving genre in the renaissance and enlightenment these books present a hierarchy of hell descriptions of demons and magical formulas for results as mundane as a warm bath and as extraordinary as raising the dead this talk describes an approach to exploring the content and historical context of these books as a data problem through algorithms graph data structures and a whole lot of old fashioned research 15 30 00 data visualizations using d3 js and c room 1 princiya marina d3 js is a power tool for data visualizations data visualizations are only good if people see them and there s no better place to see them than on the internet in your browser c is still considered a popular choice when it comes to programming and machine learning node js addons are dynamically linked shared objects written in c or c that can be loaded into node js using the require function and used just as if they were an ordinary node js module they are used primarily to provide an interface between javascript running in node js and c c libraries i have built a framework which comprises of node js c and d3 js for interactive web visualizations d3 js is a javascript library added to the front end of any web application the back end the server node js and c library will generate the necessary data the part of the application the users interact with the front end will use d3 js using this approach one can leverage the power of c for manipulating large data sets and d3 js for showing beautiful visualizations on the browser 16 30 00 keynote keynote sarah gold schedule wednesday 09 00 00 breakfast hangout time break 10 30 00 keynote keynote jenny bryan 11 30 00 data packages and frictionless data for research gallery dan fowler data driven work is an ever increasing part of research at the same time there is very significant friction around the acquisition sharing and reuse of data based on working both with researchers and government for more than a decade on the issues surrounding data sharing and use we have identified a specific subproblem which is both significant and tractable the development and adoption of a lightweight specification and associated tooling for packaging tabular data and transporting it easily and efficiently from one tool or one user to another the approach is titled data package because our work has close analogy with containerization in shipping and packaging in software watch video 11 30 00 notsobig data crunching wikipedia referrer logs room 1 joe wass 11 30 00 this is not a map building interactive maps with csvs creative themes and curious geometries room 4 aurelia moser the meaning of map across disciplines is remarkably varied it s effectively a spatial representation of geo topography a linking between tables by foreign key a datatype in c today coders make creative use of custom basemaps building remarkable maps of multivariate information off the beaten geographic projection many have designed and published interactive maps of cemetery burial plots galactic drawings of...