{"id":135,"date":"2020-03-11T12:30:14","date_gmt":"2020-03-11T10:30:14","guid":{"rendered":"https:\/\/opensocialclusters.eu\/wdev\/?page_id=135"},"modified":"2020-04-13T14:51:13","modified_gmt":"2020-04-13T12:51:13","slug":"tools-and-services-about-open-data","status":"publish","type":"page","link":"https:\/\/opensocialclusters.eu\/wdev\/list-of-open-data\/tools-and-services-about-open-data\/","title":{"rendered":"Tools and Services about Open Data"},"content":{"rendered":"\n<h3><strong>Excel\/CSV\/Tabular Data Extraction Tools<\/strong><\/h3>\n\n\n\n<ul><li>\n\t<a href=\"http:\/\/any23.apache.org\/any23-plugins.html\">Apache Any23<\/a>\n \u2014 Anything To Triples&#8217; (any23) is a library, a web service and a \ncommand line tool that extracts structured data from Web documents. \u2014 <em>From:<\/em><a href=\"http:\/\/apache.org\">Apache<\/a><em> &#8211; Tags: RDF, RDFa, Microdata, Microformats, CSV<\/em>&nbsp;\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/project-open-data\/csv-to-api\">CSV to API<\/a> &#8211; Dynamically generate RESTful APIs from static CSVs. Provides JSON, XML, and HTML.\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/commonwealth-of-puerto-rico\/libre\">Libre Information Batch Restructuring Engine<\/a> &#8211; Open data conversion and API tool, created by the Office of the Chief Information Officer of the Commonwealth of Puerto Rico.\n\t<\/li><li>\n\t[Datset] (<a href=\"http:\/\/ramblings.mcpher.com\/Home\/excelquirks\/json\">http:\/\/ramblings.mcpher.com\/Home\/excelquirks\/json<\/a>): Anything jSon to Excel related, and library of Rest API\/Excel integrations &#8211; Tags: jSon, Rest , Excel\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/timrdf\/csv2rdf4lod-automation\/wiki\">csv2rdf4lod automation<\/a>:\n (aka &#8220;csv2rdf4lod&#8221;) csv2rdf4lod provides a quick and easy way to \nproduce an RDF encoding of data available in CSV format. csv2rdf4lod \nalso functions as a custom reasoner tailored for heavy-duty data \nintegration. Although csv2rdf4lod can handle tabular data from \nwell-structured RDBMS dumps, its forte is in handling &#8220;messier&#8221; tabular \ndata created manually or using less rigorous information modeling \nstrategies &#8212; perfect for handling real data that evolved &#8221;in the \nwild&#8221;. In either case, csv2rdf4lod is designed to aggregate and \nintegrate multiple versions of multiple datasets of multiple source \norganizations in an incremental and backward-compatible way. Strong \nemphasis on provenance. &#8211; <em>From:<\/em><a href=\"https:\/\/github.com\/timrdf\">Tim Lebo<\/a><em> @<\/em><a href=\"http:\/\/tw.rpi.edu\/\">TWC RPI<\/a><em> &#8211; Tags: csv, RDF, linked data, data quality, reconciliation, transformation, enhancement, provenance, linking, workflow<\/em>\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/digital-preservation\/csv-tools\">csv2xml<\/a>: An XSLT for converting CSV to XML; _From:<a href=\"http:\/\/www.nationalarchives.gov.uk\"> The National Archives<\/a> &#8211; Tags: XML, CSV, TSV\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/harelba\/q\">q<\/a>: q allows performing SQL-like statements on tabular text data, including joins and subqueries; &#8211; Tags: CSV, TSV\n\t<\/li><li>\n\t<a href=\"http:\/\/code.google.com\/p\/google-refine\/\">Google Refine<\/a> (note that this will become Open Refine, soon): Allows to clean up, transform, and link data in tabular form \u2014 <em>From:<\/em><a href=\"http:\/\/google.com\">Google<\/a><em> &#8211; Tags: cleaning, transformation, tabular data, linking, reconciliation, desktop tool<\/em>\n\t<\/li><li>\n\t<a href=\"https:\/\/github.com\/okfn\/messytables\">MessyTables<\/a>:\n Python library to cope well opening the various variants of CSV and \nExcel files. It is used by OpenSpending amongst other OKF projects.\n\t<\/li><li>\n\t<a href=\"http:\/\/virtuoso.openlinksw.com\/dataspace\/dav\/wiki\/Main\/VirtSponger\">OpenLink Virtuoso Sponger<\/a>:\n Existing Cartridges support transformation from CSV and other tabular \nformats, among many other targets, to RDF. More cartridges are always \nunder development.\n\t<\/li><li>\n\t<a href=\"http:\/\/refine.deri.ie\/\">RDF Refine<\/a>: Google Refine extension for exporting RDF \u2014 <em>From:<\/em><a href=\"http:\/\/deri.ie\">DERI<\/a><em> &#8211; Tags: RDF, linking, reconciliation, plug-in<\/em>\n\t<\/li><li>\n\t<a href=\"https:\/\/scraperwiki.com\/\">ScraperWiki<\/a>: Collaborative routine scraping of websites and Excel files to create an API \u2014 <em>From:<\/em><a href=\"https:\/\/scraperwiki.com\/\">ScraperWiki<\/a><em> &#8211; Tags: HTML, CSV, Excel, API, scraping<\/em>\n\t<\/li><li>\n\t<a href=\"http:\/\/idi.fundacionctic.org\/tabels\/\">Tabels<\/a>: Allows to clean up, transform, and link data, not only CSV, etc. but also PC-Axis, ESRI shapefile, etc. \u2014 <em>From:<\/em><a href=\"http:\/\/www.fundacionctic.org\/en\">CTIC<\/a><em> &#8211; Tags: cleaning, transformation, tabular data, linking, reconciliation, online tool<\/em>\n\t<\/li><li>\n\t<a href=\"http:\/\/xlwrap.sourceforge.net\/\">XLWrap<\/a>:\n A spreadsheet-to-RDF wrapper, capable of transforming spreadsheets to \narbitrary RDF graphs based on a mapping specification. It supports \nMicrosoft Excel and OpenDocument spreadsheets such CSV\/TSV files and it \ncan load local files or download remote files via HTTP. \u2014 <em>From:<\/em><a href=\"http:\/\/www.langegger.at\/\">Andreas Langegger<\/a><em> &#8211; Tags: RDF, Excel, CSV, TSV<\/em>\n\t<\/li><li>\n\t<a href=\"http:\/\/shancarter.com\/data_converter\/\">Mr. Data Convertor<\/a>:\n Will convert your Excel data into one of several web-friendly formats, \nincluding HTML, JSON and XML. Tags: HTML, JSON, XML, Excel, MySQL, Ruby_\n\t<\/li><li>\n\t<a href=\"http:\/\/github.com\/cygri\/tarql\">Tarql<\/a>: Small command-line tool for converting CSV to RDF, with a user-defined mapping expressed in standard SPARQL. <em>From:<\/em><a href=\"http:\/\/richard.cyganiak.de\/\">Richard Cyganiak<\/a><em> &#8211; Tags: RDF, CSV, SPARQL<\/em>\n\t<\/li><\/ul>\n\n\n\n<h2><strong>Analysis \/ Data Mining Tools<\/strong><\/h2>\n\n\n\n<ul><li>\n\t[R] (<a href=\"http:\/\/www.r-project.org\/\">http:\/\/www.r-project.org\/<\/a>): focused on statistical analysis, but many packages available.\n\t<\/li><li>\n\t[Weka] (<a href=\"http:\/\/www.cs.waikato.ac.nz\/ml\/weka\/\">http:\/\/www.cs.waikato.ac.nz\/ml\/weka\/<\/a>)\n\t<\/li><\/ul>\n\n\n\n<h2><strong>Visualisation Tools<\/strong><\/h2>\n\n\n\n<p><em>See list in<\/em><a href=\"http:\/\/schoolofdata.org\/handbook\/reference\/visualization\/\">Data Wrangling Handbook<\/a><\/p>\n\n\n\n<ul><li> <a href=\"http:\/\/ckan.org\/\">ckan<\/a>: Has some visualisation, particularly around geolocation data. <ul><li> Spreadsheet previewer and grapher &#8211; (<a href=\"http:\/\/okfnlabs.org\/recline\/\">http:\/\/okfnlabs.org\/recline\/<\/a>) <\/li><li> WMS viewer using OpenLayers &#8211; (<a href=\"https:\/\/bitbucket.org\/dread\/ckanext-os\">https:\/\/bitbucket.org\/dread\/ckanext-os<\/a>)  <\/li><\/ul><\/li><li> <a href=\"http:\/\/mapbox.com\/tilemill\/\">TileMill\/Mapbox<\/a>: Interactive map builder. <\/li><li> d3js <\/li><li> <a href=\"https:\/\/github.com\/ktym\/d3sparql\">D3sparql<\/a>: a Javascript library that uses D3js to transform SPARQL query results into cool visualizations. <\/li><li> Gephi <\/li><li> Google Visualisation Tools <\/li><li> <a href=\"http:\/\/lodvisualization.appspot.com\/\">LODvis<\/a> <\/li><li> <a href=\"http:\/\/ode.openlinksw.com\/\">OpenLink Data Explorer (ODE)<\/a> <\/li><li> <a href=\"http:\/\/www.openlinksw.com\/dataspace\/dav\/wiki\/Main\/VirtTipsAndTricksGuide#Pivot%20Viewer%20and%20CXML\">Pivot Viewer<\/a> <\/li><li> Processing <\/li><li> [R] (<a href=\"http:\/\/www.r-project.org\/\">http:\/\/www.r-project.org\/<\/a>) <ul><li> <a href=\"http:\/\/cran.r-project.org\/web\/packages\/SPARQL\/\">SPARQL for R<\/a>  <\/li><\/ul><\/li><li> <a href=\"https:\/\/cartodb.github.io\/odyssey.js\/\">Odyssey<\/a>: combining maps and storytelling <\/li><li> <a href=\"https:\/\/cartodb.com\/\">CartoDB<\/a>: maps from data <\/li><li> <a href=\"https:\/\/datawrapper.de\/\">Datawrapper<\/a>: outstanding open source tool for simple charts on the web. <\/li><li> <a href=\"http:\/\/sextant.di.uoa.gr\/\">Sextant<\/a>: a web-based and mobile ready platform for visualizing, exploring and interacting with time-evolving linked geospatial data <\/li><li> <a href=\"https:\/\/rawgraphs.io\/\">RAWGraphs <\/a>is an open web tool to create custom vector-based visualizations <\/li><\/ul>\n\n\n\n<h3><strong>SDMX&nbsp; Tools<\/strong><\/h3>\n\n\n\n<ul><li>\n\t<a href=\"https:\/\/ec.europa.eu\/eurostat\/web\/sdmx-infospace\/sdmx-it-tools\/sdmx-converter\">SDMX Converter<\/a>&nbsp;\n The SDMX Converter is a tool that converts statistical datasets between\n different formats. It is a Java application which is actively developed\n by Eurostat and is published as open source software.&nbsp;\n\t<\/li><li>\n\t<a href=\"https:\/\/sdmxcentral.imf.org\/\">IMF SDMX Central<\/a>&nbsp;\n The IMF SDMX Central offers a free data conversion service for excel \ndatasets. Validation conducted prior to conversion ensures the datasets \nhave a suitable structure to convert to SDMX. In addition to Excel to \nSDMX, SDMX Central can convert a dataset from CSV to SDMX, and can \nconvert SDMX files to either Excel or CSV.&nbsp;\n\t<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Excel\/CSV\/Tabular Data Extraction Tools Apache Any23 \u2014 Anything To Triples&#8217; (any23) is a library, a web service and a command line tool that extracts structured data from Web documents. \u2014 From:Apache &#8211; Tags: RDF, RDFa, Microdata, Microformats, CSV&nbsp; CSV to API &#8211; Dynamically generate RESTful APIs from static CSVs. Provides JSON, XML, and HTML. Libre Information Batch Restructuring Engine &#8211; Open data conversion and API tool, created by the Office of the Chief Information Officer of the Commonwealth of Puerto [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":131,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":[],"_links":{"self":[{"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/pages\/135"}],"collection":[{"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/comments?post=135"}],"version-history":[{"count":4,"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/pages\/135\/revisions"}],"predecessor-version":[{"id":237,"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/pages\/135\/revisions\/237"}],"up":[{"embeddable":true,"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/pages\/131"}],"wp:attachment":[{"href":"https:\/\/opensocialclusters.eu\/wdev\/wp-json\/wp\/v2\/media?parent=135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}