TL, DR Selenium is one of the main libraries for browser automation and web scraping. Sometimes it is painful to integrate with browsers that are installed as Snap packages, this guide gives you a few examples for a correct configuration. What are Snap packages? Snap packages is the new and preferred way to distribute applications… Continue reading Use Python Selenium with Snap browsers
Category: Web
Set your User Agent with Python Requests, Scrapy, and Selenium
TL, DR When you crawl the web to collect data you should set a User Agent that identifies you. Or one that hides the tool you are using. Here you can find how to set the User Agent in Python Requests, Scrapy, and Selenium. What is the User Agent? A User Agent is a string… Continue reading Set your User Agent with Python Requests, Scrapy, and Selenium
Fetch and display an image with PyScript
TL, DR PyScript is a new and cool piece of technology that let you use Python in the browser. In this tutorial we will create a webpage that fetch and display a cat image. More tutorials on PyScript to come! Use PyScript to fetch and display an image Python is famous for running everywhere. Jupyter… Continue reading Fetch and display an image with PyScript
Alpha Vantage API: Free financial markets data
TL, DR Alpha Vantage is a free API where you can get financial markets data. It provides you stocks, Forex, and cryptocurrency data feed, as well as many technical and economic indicators. You can get a free API key at this link. You can get higher limits for API utilization by holding Alpha Vantage Coins… Continue reading Alpha Vantage API: Free financial markets data
Scrapy: Select elements containing a specific text
TL, DR Scrapy is one of the top frameworks for web scraping in Python. Often you need to select some element where you already know part of its text. This post shows you how to select elements containing a certain text with CSS and XPATH selectors. How to select elements containing a certain text in… Continue reading Scrapy: Select elements containing a specific text
Call an API from PyScript
TL, DR PyScript is a new and cool piece of technology that let you use Python in the browser. In this tutorial we will call an API from PyScript and display the result on our webpage. More tutorials on PyScript to come! How to make HTTP requests from PyScript to an external API? PyScript, a… Continue reading Call an API from PyScript
PyScript REPL in a webpage
TL, DR PyScript is a new and cool piece of technology that let you use Python in the browser. In this tutorial we will embed a PyScript REPL in a webpage. More tutorials on PyScript to come! Embed a PyScript REPL in a webpage Python is famous for running everywhere. Jupyter Notebooks enabled professionals and… Continue reading PyScript REPL in a webpage
Export a Pandas DataFrame to HTML table
TL, DR If you ever tried to write a big table in HTML from scratch, you know how much it can be tedious. Fortunately, there are ways to convert data from a Pandas DataFrame to a HTML table with a simple call. Making tables in HTML from Pandas DataFrames HTML is the standard language of… Continue reading Export a Pandas DataFrame to HTML table
Collaborative edit for Jupyter Notebooks
TL, DR Jupyter Notebooks are one of the most common tools for data scientist to explore new challenges and prototype solutions. In most cases, this process is a collaborative one. And since a couple of years, it would be quite common that you will interact with your co-workers remotely. Collaborative edit capabilities for Jupyter Notebooks… Continue reading Collaborative edit for Jupyter Notebooks
Minio, a powerful self-hosted object storage
TL, DR Minio is a powerful open source self-hosted object storage, similar to S3, that you can deploy on your own hardware or cloud instance. You can also deploy it on a Raspberry Pi. It has a comprehensive Python SDK for all operations. Minio Server Minio is a powerful open source software that enables you… Continue reading Minio, a powerful self-hosted object storage
