And other insights from 7 years of anonymous Wikipedia edits by government employees
4 ways to make self-updating Datawrapper charts
Datawrapper is right now the best tool for creating quick and simple charts. It’s so useful and feature-rich that news organizations that had their own in-house charting tool are switching over. One of its best features is the ability to connect a CSV file hosted on the web as a data source. This enables users […]
Using NLP to analyze open-ended responses in surveys
One of the final frontiers of data analysis is making sense of unstructured text like reports and open-ended responses in surveys. Natural language processing (NLP), with the help of AI, is making this kind of analysis more accessible. Libraries like spaCy and Gensim, although still code-based, are simplifying the process of getting insights out of […]
How data and transparency can restore trust in journalism: a speech to the Concordia Library Research Forum
This is the text of the keynote speech I delivered at the 2018 Concordia Library Research Forum. It has been edited slightly. Thank you for this lovely opportunity to be among you this morning. I feel especially honoured to deliver this keynote because I believe librarians and journalists share a special kinship because our jobs […]
Setting up a Selenium web scraper on AWS Lambda with Python
TL;DR: This post details how to get a web scraper running on AWS Lambda using Selenium and a headless Chrome browser, while using Docker to test locally. It’s based on this guide, but it didn’t work for me because the versions of Selenium, headless Chrome and chromedriver were incompatible. What did work was the following: serverless-chrome v. […]
What I learned in 3 hours about doing great data journalism at the New York Times and ProPublica
This post originally appeared on Medium. I was fortunate to take part in the Data Journalism Unconference hosted by Global Editors Network in New York this week. Attendees had the option of visiting two newsrooms for a “study tour” of their data teams. I chose the New York Times and ProPublica, two publications I admire. […]
It’s foolish to rank psychedelic drugs, but I’m going to try anyway
Erowid.org is a website with an overwhelming amount of information about drugs. It curates scientific literature, legal documents, cultural uses, and user experiences on all kinds of substances. It’s well known among those who use psychoactive drugs for self-exploration. I like to call it Encyclopaedia Psychonautica. One of the more interesting sections of the website is the […]
A look at Canada’s international trade through maps and charts
Canada has trade relations with 224 countries and territories, with which it trades more than 5,500 types of products and services. In 2014, Canada imported $511 billion in goods, and exported $525 billion, according to data from Statistics Canada. But who are our main trading partners, and what kind of goods flow back and forth […]
How I made the Montreal street history map
Click here to see the map at Huffington Post Québec First of all, a clarification. I did not really make that map. I adapted the code from Noah Veltman’s San Francisco history map, and made one for Montreal. Compare both maps, and you’ll see they are very similar in many ways. That said, the data sources […]
The best PyCon 2015 videos for journalists
PyCon is the world’s biggest conference for Python programmers, with great talks for both veterans and newcomers. And every year, organizers publish videos of talks and workshops for free for all to enjoy. Here is my selection of videos from this year’s conference in Montreal that I believe are of value for journalists who use […]