TL, DR GSConnect is a great open source app to connect your phone to your Linux PC. At the time of writing, when you try to mount the phone file system on your PC, you are most likely to get an error. Here a few steps to fix this issue. Mounting your phone from GSConnect… Continue reading Fix GSConnect not mounting Android phone in the file system
Tag: Tools
Fix Flatpak browser not opening links in Ubuntu
TL, DR Sometimes Ubuntu stages a coup, setting the Snap internet browser as default. This may break your setup if you actually instralled your browser using Flatpak. Here a few steps to fix this issue. Flatpak vs. Snap Ubuntu has a strong preference for Snaps…but maybe you don’t necessarily agree with this and you prefer… Continue reading Fix Flatpak browser not opening links in Ubuntu
Use Python Selenium with Snap browsers
TL, DR Selenium is one of the main libraries for browser automation and web scraping. Sometimes it is painful to integrate with browsers that are installed as Snap packages, this guide gives you a few examples for a correct configuration. What are Snap packages? Snap packages is the new and preferred way to distribute applications… Continue reading Use Python Selenium with Snap browsers
Set your User Agent with Python Requests, Scrapy, and Selenium
TL, DR When you crawl the web to collect data you should set a User Agent that identifies you. Or one that hides the tool you are using. Here you can find how to set the User Agent in Python Requests, Scrapy, and Selenium. What is the User Agent? A User Agent is a string… Continue reading Set your User Agent with Python Requests, Scrapy, and Selenium
MongoDB aggregation: save results in a Pandas DataFrame
TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to save results from aggregation pipelines into a Pandas DataFrame. From MongoDB to Pandas I already provided an introduction to MongoDB and Compass in a previous post for my… Continue reading MongoDB aggregation: save results in a Pandas DataFrame
MongoDB aggregation: match a field with values in a list
TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to match a field with values in a list to help you select. Matching values in a list I already provided an introduction to MongoDB and Compass in a… Continue reading MongoDB aggregation: match a field with values in a list
MongoDB aggregation: create your data pipelines
TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to quickly create data pipelines and create code you can use in your projects. The power of a Compass You use MongoDB as data repository because it’s so simple… Continue reading MongoDB aggregation: create your data pipelines
Fetch and display an image with PyScript
TL, DR PyScript is a new and cool piece of technology that let you use Python in the browser. In this tutorial we will create a webpage that fetch and display a cat image. More tutorials on PyScript to come! Use PyScript to fetch and display an image Python is famous for running everywhere. Jupyter… Continue reading Fetch and display an image with PyScript
Pandas: Convert list to dummies
TL, DR Sometimes you may have a list in a Pandas DataFrame column and you are looking to get individual dummy columns for further elaborations. Here a very short guide about how to convert a list to individual dummies. From list to dummies In many cases during data exploration and wrangling you will find that… Continue reading Pandas: Convert list to dummies
Scrapy: Select elements containing a specific text
TL, DR Scrapy is one of the top frameworks for web scraping in Python. Often you need to select some element where you already know part of its text. This post shows you how to select elements containing a certain text with CSS and XPATH selectors. How to select elements containing a certain text in… Continue reading Scrapy: Select elements containing a specific text
