TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to save results from aggregation pipelines into a Pandas DataFrame. From MongoDB to Pandas I already provided an introduction to MongoDB and Compass in a previous post for my… Continue reading MongoDB aggregation: save results in a Pandas DataFrame
Tag: Data Science
MongoDB aggregation: match a field with values in a list
TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to match a field with values in a list to help you select. Matching values in a list I already provided an introduction to MongoDB and Compass in a… Continue reading MongoDB aggregation: match a field with values in a list
MongoDB aggregation: create your data pipelines
TL, DR MongoDB is one of the leading NoSQL databases, and its aggregation framework enables powerful queries, as well as data operations. We will see how to quickly create data pipelines and create code you can use in your projects. The power of a Compass You use MongoDB as data repository because it’s so simple… Continue reading MongoDB aggregation: create your data pipelines
Alpha Vantage API: Free financial markets data
TL, DR Alpha Vantage is a free API where you can get financial markets data. It provides you stocks, Forex, and cryptocurrency data feed, as well as many technical and economic indicators. You can get a free API key at this link. You can get higher limits for API utilization by holding Alpha Vantage Coins… Continue reading Alpha Vantage API: Free financial markets data
Pandas: Convert list to dummies
TL, DR Sometimes you may have a list in a Pandas DataFrame column and you are looking to get individual dummy columns for further elaborations. Here a very short guide about how to convert a list to individual dummies. From list to dummies In many cases during data exploration and wrangling you will find that… Continue reading Pandas: Convert list to dummies
Collaborative edit for Jupyter Notebooks
TL, DR Jupyter Notebooks are one of the most common tools for data scientist to explore new challenges and prototype solutions. In most cases, this process is a collaborative one. And since a couple of years, it would be quite common that you will interact with your co-workers remotely. Collaborative edit capabilities for Jupyter Notebooks… Continue reading Collaborative edit for Jupyter Notebooks
Import NA strings in Pandas the right way
TL, DR Pandas has great parsing tools to let you import data from multiple file formats (CSV, Excel, etc…). Sometimes in your data you have “NA” strings that are valid values. However, Pandas default will consider those strings as markers for missing values. Below some option you can use to prevent this default and import… Continue reading Import NA strings in Pandas the right way
Visualize and export full Pandas DataFrames as images
TL, DR Columns or fields truncation when visualizing Pandas DataFrames can be annoying. Exporting data views for use in other contexts (such as a blog post) may also not be immediate. Using Pandas options and the dataframe-image package we can easily visualize DataFrames in their full extent (without columns of fields truncation) and save this… Continue reading Visualize and export full Pandas DataFrames as images
