TL;DR: This post details how to get a web scraper running on AWS Lambda using Selenium and a headless Chrome browser, while using Docker to test locally. It’s based on this guide, but it didn’t work for me because the versions of Selenium, headless Chrome and chromedriver were incompatible. What did work was the following: serverless-chrome v. […]
Click here to see the map at Huffington Post Québec First of all, a clarification. I did not really make that map. I adapted the code from Noah Veltman’s San Francisco history map, and made one for Montreal. Compare both maps, and you’ll see they are very similar in many ways. That said, the data sources […]
PyCon is the world’s biggest conference for Python programmers, with great talks for both veterans and newcomers. And every year, organizers publish videos of talks and workshops for free for all to enjoy. Here is my selection of videos from this year’s conference in Montreal that I believe are of value for journalists who use […]
See the live map here. Jqvmap is an excellent JavaScript library for making sleek D3-style interactive vector maps quickly and easily. However, its suggested technique for visualizing data (see the library’s documentation) leaves something to be desired. This post suggests another way, using Geostats, another excellent JS library. To be clear: jqvmap’s dataviz technique works, […]
I’ve recently fallen in love with Python’s standard calendar module. It has lots of functions to make handling dates a breeze. And for scraping data based on dates, it couldn’t be more convenient. Take Environment Canada’s historical hourly data for Montreal. Each page has 24 hours of data in a single day. If I want […]