Meta tags:
Headings (most frequently used words):
data, and, the, csv, in, open, for, to, of, with, from, at, on, csvs, web, wikipedia, keynote, public, work, building, can, is, conversion, as, free, knowledge, using, spreadsheets, one, documents, richard, smith, ben, schedule, conf, creative, source, science, by, registers, authoritative, lists, you, trust, dynamic, driven, stenci, la, hangout, time, speakers, who, more, information, easy, massive, scale, reuse, scientific, outputs, this, not, map, interactive, maps, themes, curious, geometries, there, back, again, automatic, detection, logical, table, structures, master, dataset, approaches, publishing, bidirectional, nested, json, rinse, repeat, what, we, learn, xlsx, describing, image, collections, without, any, staff, democratising, financial, times, distributing, dat, serving, browser, donations, wikidata, how, get, your, into, base, life, death, decisions, powered, grimoires, demonology, databases, wordpress, hackers, trying, stay, relevant, linked, structured, journalism, bbc, packages, frictionless, research, fighting, against, chaotically, separated, values, embulk, bigchaindb, blockchain, database, decentralized, world, computer, tools, google, gotta, catch, em, all, recognizing, sloppy, crowdsourcing, tasks, making, part, comma, chameleon, desktop, editor, week, together, share, explore, jupyter, notebooks, catmandu, toolkit, increasing, access, under, ressourced, languages, visualizations, d3, js, through, hoop, got, 99, problems, was, ons, databaker, pretty, useful, notsobig, crunching, referrer, logs, mapping, unmappable, creating, transit, megacity, lunch, break, jenny, bryan, sarah, gold, jeremy, freeman, zara, rahman, unna, aurelia, moser, till, doehmen, jones, webb, mathieu, jacomy, brian, scott, renton, matt, chadburn, karissa, mckelvey, foxall, jens, ohlig, serah, njambi, mouse, reeve, jure, triglav, adam, white, basile, simon, dan, fowler, sadayuki, furuhashi, greg, mcmullen, thomas, steiner, maciej, gryka, jeni, tennison, stuart, harrison, micheleen, harris, johann, rolschewski, lucie, aime, kaffee, princiya, marina, sebastian, komianos, michaela, benyohai, philip, potter, darren, barnes, joe, wass, oliver, buchtala, mohamed, hegazy, michael, aufreiter, v2, statistics, professor, university, british, columbia, takes, special, delight, analysis, computing, designer, interested, interaction, networks, domain, she, founder, company, if, neuroscientist, hhmi, janelia, working, binder, lightning, researcher, writer, activist, whose, focuses, bridging, gap, between, activists, technologists, see, full, list, community, those, love, big, small, made, possible, following, generous, sponsors, presenters, breakfast, outros, goodbye, coffee, 6pm, check, out, v1, location, tuesday, wednesday, organizers,
Text of the page (most frequently used words):
the (200), and (172), data (127), for (71), csv (48), this (42), with (38), open (32), from (31), that (29), are (23), can (23), room (22), web (21), how (19), will (18), watch (18), have (18), tool (18), video (17), #wikipedia (16), you (16), using (16), all (15), talk (15), conf (14), use (14), into (14), work (14), like (14), #spreadsheets (14), tools (13), our (13), see (12), access (12), its (12), about (12), gallery (12), format (12), has (12), which (11), knowledge (11), https (11), public (11), more (10), information (10), http (10), these (10), csvs (10), through (10), building (10), their (10), github (9), any (9), com (9), one (9), also (9), them (9), free (9), make (9), they (9), keynote (9), share (9), google (9), based (8), not (8), break (8), other (8), who (8), users (8), process (8), database (8), linked (8), maps (8), visualizations (8), your (8), well (8), creative (7), time (7), want (7), built (7), source (7), but (7), get (7), excel (7), application (7), what (7), working (7), browser (7), json (7), under (6), was (6), between (6), internet (6), people (6), org (6), easy (6), together (6), way (6), map (6), world (6), present (6), software (6), community (6), decentralized (6), interactive (6), part (6), node (6), end (6), content (6), api (6), would (6), out (5), documents (5), dat (5), digital (5), library (5), spreadsheet (5), science (5), most (5), languages (5), used (5), there (5), available (5), wikidata (5), create (5), collection (5), while (5), challenges (5), structures (5), dataset (5), gov (5), back (5), conversion (5), driven (5), been (5), massive (5), may (5), structured (5), journalism (5), catmandu (5), some (5), explore (5), reuse (5), government (5), approach (5), javascript (5), large (5), jupyter (5), notebooks (5), system (5), registers (5), 2016 (5), filtering (5), rinse (5), repeat (5), ben (5), images (4), international (4), scientific (4), standards (4), environment (4), code (4), where (4), simple (4), collaboration (4), stencila (4), show (4), give (4), www (4), help (4), comma (4), chameleon (4), possible (4), major (4), around (4), problems (4), analysis (4), non (4), service (4), services (4), logical (4), common (4), formats (4), files (4), news (4), relevant (4), features (4), interface (4), machine (4), useful (4), research (4), both (4), than (4), because (4), power (4), look (4), platform (4), trust (4), crowdsourcing (4), learn (4), file (4), smith (4), often (4), then (4), nested (4), standard (4), distributing (4), richard (4), wordpress (4), collections (4), scale (4), berlin (4), conference (4), here (3), license (3), list (3), dan (3), fowler (3), attendees (3), read (3), hangout (3), live (3), easily (3), shared (3), language (3), provide (3), few (3), speakers (3), same (3), project (3), many (3), making (3), wiki (3), increasing (3), publication (3), wrong (3), desktop (3), editor (3), creation (3), even (3), better (3), year (3), statistics (3), organisations (3), serving (3), 000 (3), megacity (3), developing (3), citizens (3), mapping (3), creating (3), tabular (3), comes (3), automatic (3), detection (3), table (3), canonical (3), when (3), again (3), suite (3), take (3), life (3), death (3), decisions (3), kenya (3), gap (3), dynamic (3), stenci (3), bbc (3), now (3), full (3), today (3), trying (3), stay (3), hackers (3), such (3), development (3), specific (3), toolkit (3), traditional (3), pretty (3), called (3), databaker (3), package (3), allows (3), ons (3), bigchaindb (3), had (3), blockchain (3), without (3), central (3), themes (3), very (3), sharing (3), schedule (3), good (3), programming (3), learning (3), just (3), running (3), grimoires (3), books (3), early (3), problem (3), offer (3), behind (3), processing (3), quality (3), chaotically (3), donations (3), upload (3), technical (3), integrity (3), datasets (3), authoritative (3), lists (3), sloppy (3), xlsx (3), high (3), bidirectional (3), small (3), master (3), nuclear (3), rest (3), university (3), record (3), outputs (3), text (2), released (2), html (2), design (2), turn (2), forked (2), template (2), presentation (2), talks (2), over (2), spectrum (2), including (2), query (2), testing (2), w3c (2), profit (2), following (2), collaborative (2), function (2), python (2), complex (2), updated (2), anyone (2), substance (2), foundation (2), jure (2), triglav (2), barriers (2), makes (2), kind (2), topics (2), only (2), covered (2), don (2), reach (2), lucie (2), aime (2), kaffee (2), ressourced (2), really (2), benefits (2), job (2), mind (2), bit (2), call (2), publish (2), along (2), taking (2), why (2), putting (2), stuart (2), harrison (2), week (2), order (2), basketball (2), europe (2), improve (2), try (2), formatted (2), sebastian (2), komianos (2), hoop (2), got (2), cairo (2), transportation (2), africa (2), health (2), transport (2), provides (2), describe (2), capture (2), real (2), mohamed (2), hegazy (2), unmappable (2), transit (2), decided (2), variables (2), long (2), itself (2), two (2), automatically (2), convert (2), aim (2), till (2), doehmen (2), apps (2), issues (2), communities (2), serah (2), njambi (2), powered (2), bridging (2), coders (2), accessible (2), key (2), allowing (2), oliver (2), buchtala (2), michael (2), aufreiter (2), labs (2), years (2), core (2), model (2), facts (2), basile (2), simon (2), youtube (2), jeremy (2), freeman (2), lunch (2), modules (2), storage (2), records (2), domain (2), johann (2), rolschewski (2), office (2), scraper (2), converting (2), sheet (2), effectively (2), robust (2), overview (2), output (2), engage (2), wider (2), darren (2), barnes (2), instance (2), projects (2), dream (2), enough (2), greg (2), mcmullen (2), computer (2), meaning (2), representation (2), custom (2), basemaps (2), off (2), human (2), historical (2), yet (2), aurelia (2), moser (2), curious (2), geometries (2), joe (2), wass (2), notsobig (2), crunching (2), referrer (2), logs (2), ever (2), significant (2), packaging (2), user (2), packages (2), frictionless (2), jenny (2), bryan (2), sarah (2), gold (2), place (2), libraries (2), front (2), server (2), generate (2), interact (2), princiya (2), marina (2), magical (2), made (2), context (2), whole (2), lot (2), mouse (2), reeve (2), demonology (2), databases (2), opinions (2), going (2), garbage (2), systems (2), quick (2), collaborating (2), cleaning (2), hopefully (2), micheleen (2), harris (2), offered (2), within (2), online (2), whose (2), created (2), thomas (2), steiner (2), 2015 (2), matt (2), chadburn (2), democratising (2), financial (2), times (2), plugin (2), sadayuki (2), furuhashi (2), fighting (2), against (2), separated (2), values (2), embulk (2), find (2), discussion (2), jens (2), ohlig (2), base (2), blog (2), register (2), country (2), twitter (2), michaela (2), benyohai (2), philip (2), potter (2), solve (2), maciej (2), gryka (2), gotta (2), catch (2), recognizing (2), tasks (2), past (2), left (2), brian (2), interaction (2), could (2), jeni (2), tennison (2), zara (2), rahman (2), sciences (2), however (2), interesting (2), since (2), refine (2), visualization (2), capabilities (2), different (2), filter (2), mathieu (2), jacomy (2), flat (2), flatten (2), webb (2), network (2), bandwidth (2), uptime (2), those (2), karissa (2), mckelvey (2), websites (2), ends (2), enable (2), reactor (2), jones (2), approaches (2), publishing (2), new (2), adam (2), white (2), special (2), luna (2), workflow (2), various (2), macro (2), runs (2), need (2), run (2), scott (2), renton (2), describing (2), image (2), staff (2), unna (2), foxall (2), kalkscheune (2), germany (2), love (2), makers (2), ticket (2), dec (2), css, reused, mit, fork, site, martini, peoplesopen, net, commons, attribution, view, speaker, summaries, coverage, slides, videos, lanyrd, first, held, 2014, hosted, upcoming, check, announcement, poster, sticker, sponsorship, prospectus, barratt, max, ogden, martin, fenner, datacite, karthik, ram, ropensci, elaine, wong, cbc, john, chodacki, california, event, organized, unpaid, volunteers, organizers, questions, contact, coord, googlegroups, dot, csvconference, strives, supportive, welcoming, encourage, enforcing, conduct, 6pm, outros, goodbye, coffee, app, each, cell, coko, biggest, accessing, tend, hard, issue, widely, internationally, speak, potentially, vital, multilingual, mediawiki, extension, articleplaceholder, team, willing, interns, put, helps, compliant, validate, led, talking, earlier, started, scrapping, analysing, anywhere, advanced, competitions, teams, players, agents, fans, understanding, happening, games, demonstrate, pitfalls, beginner, ran, existent, weirdly, sparse, architecture, million, inhabitants, km2, area, metro, lines, 4529, buses, registered, microbuses, estimated, unregistered, taxis, little, informal, dominates, provision, intense, competition, limited, urban, road, space, leads, chronic, congestion, countries, negatively, impacting, climate, safe, clean, affordable, opportunities, goods, amenities, city, awaiting, limitations, existing, complexity, plethora, shapes, flavors, structure, publisher, wide, columns, variable, name, column, entry, mixtures, identifiers, categories, observations, methods, overall, reduce, amount, janitorial, currently, required, ingesting, evaluate, scraped, quack, doctors, concern, medical, practitioners, board, partnership, largest, blue, collar, newspaper, impact, starhealth, clickers, reproducibility, true, interfaces, pushing, aggregator, concepts, fledged, functionalities, production, quotes, articles, answer, lie, x1boqjxlv2a, ease, import, retrieval, export, transformation, meta, combine, frameworks, document, stores, mongodb, indexes, elasticsearch, rapid, after, short, introduction, command, line, cli, dsl, last, national, hooked, produce, too, spread, much, readable, usable, freely, wrapper, xypath, produced, baker, recipes, extract, flexible, brief, moving, forward, adding, uris, fields, hope, interest, adapting, always, knew, ethereum, ipfs, chance, contribution, fully, discuss, organization, cohesive, administer, authority, potential, across, disciplines, remarkably, varied, spatial, geo, topography, linking, tables, foreign, datatype, remarkable, multivariate, beaten, geographic, projection, designed, published, cemetery, burial, plots, galactic, drawings, star, wars, universe, sequence, genes, heatmaps, court, traffic, during, nba, finals, artisanal, vehicle, innovation, geocoding, handmade, investigate, interactives, detailing, unmapped, might, perfect, expression, friction, acquisition, researchers, decade, surrounding, identified, subproblem, tractable, adoption, lightweight, specification, associated, tooling, transporting, efficiently, another, titled, close, analogy, containerization, shipping, breakfast, wednesday, still, considered, popular, choice, addons, dynamically, objects, written, loaded, require, were, ordinary, module, primarily, framework, comprises, added, necessary, leverage, manipulating, sets, showing, beautiful, spells, invocations, appear, 3rd, century, thriving, genre, renaissance, enlightenment, hierarchy, hell, descriptions, demons, formulas, results, mundane, warm, bath, extraordinary, raising, dead, describes, exploring, algorithms, graph, old, fashioned, looks, before, anything, important, happens, second, analytics, forecasting, recommendations, avoid, dreaded, scenario, easiest, colleagues, playing, specifically, writing, lately, scratch, pad, exploration, graphical, importantly, others, play, logic, method, demo, notebook, aimed, pre, peek, introduce, drive, edit, realtime, encyclopedia, among, means, facilitates, tomayac, permissive, apache, rebuilt, house, mission, democratise, transformed, oblique, warehouse, infrequently, understood, stream, wanted, usability, guessing, schema, edited, humans, machines, acts, wikimedia, sister, institutions, unesco, museums, curate, craft, uploads, apart, side, things, navigate, pages, gds, gdstechnology, guaranteeing, blogs, fco, guestpost, spreading, word, names, gdsteam, status, 697818739547336704, initiative, mechanism, guarantee, proofs, authenticity, know, dealing, workers, effort, come, elbow, grease, bonus, properly, persist, models, serve, predictions, ins, outs, diff, render, independently, tried, tackling, ideas, worth, considering, warts, best, imagine, suited, relied, personal, reality, social, humanities, tweets, scholars, analyze, noisy, necessity, monitoring, uneasy, poor, tableau, basic, addition, graphic, efficient, paris, médialab, meet, tackle, minimal, iterate, keeping, eye, nutshell, represented, array, spawning, synchronize, functions, accepts, leveraging, efficiency, scientists, shortcut, fry, famous, acquire, parse, mine, represent, honored, repository, medialab, defined, defining, everyone, finds, consume, contracting, 360giving, taken, hybrid, involves, representations, opendataservices, centralized, expensive, difficult, maintain, instead, drastically, increase, ensure, connecting, download, peers, already, versioned, distribute, via, workshop, leave, superior, ensuring, search, visualisation, costly, consuming, build, least, management, managing, niche, understand, creates, publicising, visual, ways, cottage, cottagelabs, patchwork, borrowed, stitched, enhanced, bridge, keep, manage, cover, transformations, generalised, visualisations, economical, couple, examples, wild, sparc, sparcopen, oaspectrum, association, figures, aspx, integrated, release, later, globally, mean, quarter, likes, bill, market, w3techs, suddenly, unprecedented, own, goals, client, educate, third, parties, edinburgh, proud, resolution, wealth, holds, discovery, handled, imaging, supplied, jp2k, zooming, presents, metadata, solr, indices, getting, presented, number, briefly, photographers, receive, readers, orders, items, found, manuscripts, recorded, worksheets, move, reasons, happened, shorthand, techniques, renames, embed, identification, tiffs, per, generated, parses, particular, covers, gives, skeleton, cataloguers, devoted, enrich, searchable, purpose, lamp, technologies, allow, crowd, further, catalogue, hived, correct, xml, processes, grown, organically, does, everything, heart, literature, optimised, components, lessons, learned, highlight, pain, points, guide, curation, efforts, browsers, powerful, requesting, displaying, though, reading, capability, right, advantages, doing, rather, script, ones, future, tuesday, johannisstr, 10117, venue, location, presenters, generous, sponsors, isn, curating, advancing, art, producing, meaningful, insight, distributed, cluster, big, folks, passionate, society, should, join, bring, doers, backgrounds, industry, stories, researcher, writer, activist, focuses, activists, technologists, neuroscientist, lightning, binder, hhmi, janelia, designer, interested, networks, she, founder, company, professor, british, columbia, takes, delight, computing, above, earthquake, noaa, rendering, thanks, coming, portland, pay, bird, april, 15th, everywhere, featuring, brightest, minds, wayback, archive, 20221223033927, csvconf, timestamps, fail, success, 2023, 2022, 2021, jan, nov, 2026, captures,
Text of the page (random words):
nted as a javascript array while spawning simple d3 visualizations that synchronize with the output of your filtering csv rinse repeat functions well with twitter data but accepts any kind of csv by leveraging the efficiency of javascript and d3 js data scientists can shortcut ben fry s famous data visualization process acquire parse filter mine represent refine interact we would be honored to present our tool and to share how we use it to explore large csv data github repository https github com medialab csv rinse repeat watch video 12 00 00 lunch break 12 30 00 keynote keynote zara rahman 13 30 00 making csv part of the web gallery jeni tennison imagine csv was a format suited to the web just as html is we would see high quality data because it would be relied on for user interaction we would see reuse of data because it could be linked that was my personal aim working on the w3c csv on the web standards i ll talk about the standards features and the work left to do to make that dream a reality watch video 13 30 00 what we can learn from xlsx room 1 brian smith for the past year i ve been learning the ins and outs of the excel file format in order to diff excel spreadsheets render them in the browser and convert them into other file formats like csvs the excel file format has been around for a long time and has independently tried to solve many of the same problems the open data community is tackling now for this talk i ll give an overview of how xlsx files work the good ideas it has worth considering as well as the warts best left behind 13 30 00 gotta catch em all recognizing sloppy work in crowdsourcing tasks room 4 maciej gryka if you have ever used crowdsourcing you know that dealing with sloppy workers is a major part of the effort come see this talk if you want to learn about how to solve this problem using machine learning and some elbow grease as a bonus you will also find out how to properly persist your ml models and use them to serve predictions through an http api watch video 14 00 00 registers authoritative lists you can trust gallery michaela benyohai philip potter we are developing software for registers an initiative from the government digital service to improve the trust services and citizens can place in government data building a mechanism to guarantee the integrity of these canonical tabular datasets on the web through the use of digital proofs of authenticity https twitter com gdsteam status 697818739547336704 https country register gov uk http blogs fco gov uk guestpost 2016 02 11 spreading the word and data on country names https gdstechnology blog gov uk 2015 10 13 guaranteeing the integrity of a register https gds blog gov uk s registers watch video 14 00 00 data donations for wikidata how to get your data into the free knowledge base room 1 jens ohlig wikidata is a free linked database that can be read and edited by both humans and machines it acts as central storage for the structured data of its wikimedia sister projects such as wikipedia in this talk we ll see how large data donations from institutions like unesco or museums can find their way into wikidata how to curate data for upload and craft code for specific uploads apart from the technical side of things we ll look at the community behind it all and how to navigate through discussion pages 14 00 00 fighting against chaotically separated values with embulk room 4 sadayuki furuhashi we created a plugin based data collection tool that can read any chaotically formatted files called csv by guessing its schema automatically watch video 14 30 00 break break 15 00 00 democratising data at the financial times gallery matt chadburn hi in 2015 the ft rebuilt it s in house data platform with a mission to democratise access to it s data i ll share about how we transformed an oblique data warehouse infrequently updated and understood by a few into a stream of real time information accessible to anyone who wanted to use it this talk is about the usability of data through it s collection to systems used to model access and query it watch video 15 00 00 wikipedia tools for google spreadsheets room 1 thomas steiner in this talk we introduce the wikipedia tools for google spreadsheets google spreadsheets is part of a free web based software office suite offered by google within its google drive service it allows users to create and edit spreadsheets online while collaborating with other users in realtime wikipedia is a free access free content internet encyclopedia whose content and data is available among other means through an api with the wikipedia tools for google spreadsheets we have created a toolkit that facilitates working with wikipedia data from within a spreadsheet context we make these tools available as open source on github https github com tomayac wikipedia tools for google spreadsheets released under the permissive apache 2 0 license 15 00 00 work together share and explore data in jupyter notebooks room 4 micheleen harris we all like to see what our data looks like before anything important happens we also like second opinions is it going to be good enough for analytics like forecasting or recommendations how do we avoid the dreaded garbage in garbage out scenario what s the easiest way to get my colleagues to take a look i ve been playing in jupyter notebooks systems specifically writing r code a lot lately i use jupyter for a scratch pad testing environment quick data exploration tool with all the graphical power r has to offer and most importantly i share these notebooks with others so they may play and explore as well as offer their opinions i m going to offer some logic behind collaborating with this simple yet interactive method of using jupyter notebooks i will also demo a notebook system running r aimed at pre processing and cleaning data as well as taking a peek at its quality hopefully we can work together 15 30 00 grimoires demonology and databases gallery mouse reeve grimoires books of spells and magical invocations appear in europe as early as the 3rd century and made up a thriving genre in the renaissance and enlightenment these books present a hierarchy of hell descriptions of demons and magical formulas for results as mundane as a warm bath and as extraordinary as raising the dead this talk describes an approach to exploring the content and historical context of these books as a data problem through algorithms graph data structures and a whole lot of old fashioned research 15 30 00 data visualizations using d3 js and c room 1 princiya marina d3 js is a power tool for data visualizations data visualizations are only good if people see them and there s no better place to see them than on the internet in your browser c is still considered a popular choice when it comes to programming and machine learning node js addons are dynamically linked shared objects written in c or c that can be loaded into node js using the require function and used just as if they were an ordinary node js module they are used primarily to provide an interface between javascript running in node js and c c libraries i have built a framework which comprises of node js c and d3 js for interactive web visualizations d3 js is a javascript library added to the front end of any web application the back end the server node js and c library will generate the necessary data the part of the application the users interact with the front end will use d3 js using this approach one can leverage the power of c for manipulating large data sets and d3 js for showing beautiful visualizations on the browser 16 30 00 keynote keynote sarah gold schedule wednesday 09 00 00 breakfast hangout time break 10 30 00 keynote keynote jenny bryan 11 30 00 data packages and frictionless data for research gallery dan fowler data driven work is an ever increasing part of research at the same time there is very significant friction around the acquisition sharing and reuse of data based on working both with researchers and government for more than a decade on the issues surrounding data sharing and use we have identified a specific subproblem which is both significant and tractable the development and adoption of a lightweight specification and associated tooling for packaging tabular data and transporting it easily and efficiently from one tool or one user to another the approach is titled data package because our work has close analogy with containerization in shipping and packaging in software watch video 11 30 00 notsobig data crunching wikipedia referrer logs room 1 joe wass 11 30 00 this is not a map building interactive maps with csvs creative themes and curious geometries room 4 aurelia moser the meaning of map across disciplines is remarkably varied it s effectively a spatial representation of geo topography a linking between tables by foreign key a datatype in c today coders make creative use of custom basemaps building remarkable maps of multivariate information off the beaten geographic projection many have designed and published interactive maps of cemetery burial plots galactic drawings of the star wars universe sequence maps of human genes heatmaps of court traffic during the nba finals for some of the most creative maps artisanal csv data is the vehicle for innovation in geocoding to non traditional historical handmade basemaps this talk will explore other maps and investigate topics and themes not yet covered in interactives detailing how to map them and why mapping unmapped data might be the perfect expression of their meaning 12 00 00 a public bigchaindb a blockchain database for the decentralized world computer gallery greg mcmullen when we built bigchaindb we always had in mind a public instance we knew that along with projects like ethereum and ipfs we had a chance to make a major contribution to the dream of a fully decentralized internet this talk will discuss the benefits of a public blockchain database the challenges in building a decentralized organization that is cohesive enough to administer itself without creating a central authority and the potential for building the decentralized internet watch video 12 00 00 ons databaker from pretty spreadsheets to useful csvs room 1 darren barnes out of the last csv conf the office for national statistics hooked up with scraper wiki to produce a tool for more easily converting the traditional and all too common pretty spread sheet into a much more open machine readable and usable csv format this tool is called databaker and is freely available on github the tool is effectively a wrapper for the useful xypath python package also produced by scraper wiki and data baker allows easy creation of recipes to extract data from spreadsheets in a robust and flexible way this talk will give a brief overview of the tool how we use it at the ons and how we see it moving forward adding linked data uris to the output fields we hope to engage community interest for adapting this tool for even wider use watch video 12 00 00 catmandu a data toolkit room 4 johann rolschewski catmandu provides a suite of software modules to ease the import storage retrieval export and transformation of meta data records combine catmandu modules with web application frameworks document stores such as mongodb and full text indexes such as elasticsearch to create a rapid development environment for digital data services after a short introduction to catmandu and its features we will present the command line interface cli and domain specific language dsl 12 30 00 lunch hangout time break 13 30 00 keynote keynote jeremy freeman https www youtube com watch v x1boqjxlv2a 14 30 00 hackers trying to stay relevant linked data and structured journalism at the bbc gallery basile simon at bbc news labs we ve been pushing for more linked data in news for years now we built a massive international news aggregator on linked data concepts and full fledged functionalities but it s our production and live services who do the core of the job today we re trying to stay relevant and to model our massive dataset of facts quotes news and articles the answer to this may lie in structured journalism watch video 14 30 00 dynamic data driven documents in stenci la room 1 oliver buchtala and michael aufreiter stencila is bridging the gap between coders and clickers to make open data driven documents that are accessible to all the key to reproducibility is collaboration and true collaboration comes from allowing people to use the interfaces they want where they want 14 30 00 life death decisions powered by csvs room 4 serah njambi talk is about code for africa s suite of simple spreadsheet based apps that help citizens take life death decisions about health issues quack doctors are a major concern in kenya using data from kenya s medical practitioners board and in partnership with kenya s largest blue collar newspaper i d like to show what impact spreadsheet based apps can have on communities bit ly starhealth watch video 15 00 00 there and back again automatic detection and conversion of logical table structures gallery till doehmen tabular data comes in a plethora of shapes and flavors the logical structure of a dataset is decided by the dataset publisher common formats are the wide format where variables are columns and the long format where the variable name is itself a column entry mixtures of the two formats are also possible we present our work on automatic detection of logical table structures e g which variables are identifiers which are categories and which are observations we also present methods to automatically convert to a canonical format overall we aim to reduce the amount of janitorial work currently required when ingesting data we evaluate our work using a collection of 20 000 csv files scraped from data gov uk watch video 15 00 00 mapping the unmappable creating public transit data in a megacity room 1 mohamed hegazy 20 million inhabitants 96 km2 area 3 metro lines 4529 public buses 15 000 registered microbuses and an estimated 80 000 unregistered shared taxis cairo is a megacity with little information on public transportation how do we map that informal public transportation dominates service provision in africa intense competition for limited urban road space leads to chronic congestion in developing countries negatively impacting the climate the environment and citizens health safe clean and affordable transport provides access to opportunities services goods and amenities in this talk we describe transport for cairo s work to map the city the challenges awaiting us and the limitations of existing data structures to capture the real world s complexity watch video 15 00 00 data through the hoop i got 99 problems and the data was one room 4 sebastian k komianos earlier this year i started scrapping and analysing data from anywhere possible in order to create a database with advanced basketball statistics from all the major basketball competitions ar...
|
