Quantcast
Channel: MungingData
Browsing index pages (26 articles)

The Virtuous Content Cycle for Developer Advocates

This post explains how to scale developer advocacy by creating content in a way that answers current user questions and makes it easier to generate additional content in the future. Developer...

View Article


DevRel Driven Development

DevRel Driven Development is driving software development from developer advocacy activities like creating documentation, writing blog posts, and producing videos. Developers advocates frequently...

View Article


Convert streaming CSV data to Delta Lake with different latency requirements

This blog post explains how to incrementally convert streaming CSV data into Delta Lake with different latency requirements. A streaming CSV data source is used because it’s easy to demo, but the...

View Article

Image may be NSFW.
Clik here to view.

Install PySpark, Delta Lake, and Jupyter Notebooks on Mac with conda

This blog post explains how to install PySpark, Delta Lake, and Jupyter Notebooks on a Mac. This setup will let you easily run Delta Lake computations on your local machine in a Jupyter notebook for...

View Article

Image may be NSFW.
Clik here to view.

Ultra-cheap international real estate markets in 2022

This post explains how to identify ultra-cheap international real estate markets and when you can capitalize on deeply discounted prices. Let’s borrow Andrew Henderson’s definition of an ultra-cheap...

View Article


Read multiple CSVs into pandas DataFrame

This post explains how to read multiple CSVs into a pandas DataFrame. pandas filesystem APIs make it easy to load multiple files stored in a single directory or in nested directories. Other Python...

View Article

Image may be NSFW.
Clik here to view.

Scale big data pandas workflows with Dask

pandas is a great DataFrame library for datasets that fit comfortably in memory, but throws out of memory exceptions for datasets that are too large. This post shows how pandas works well for a small...

View Article

Writing NumPy Array to Text Files

This post explains the different ways to save a NumPy array to text files. After showing the different syntax options the post will teach you some better ways to write NumPy data: using binary file...

View Article


Image may be NSFW.
Clik here to view.

Content creators making more than $50,000 a month

This post demonstrates how much money you can make as a content creator and contrasts the content creation and restaurant business models. Content creators can make a lot of money and enjoy a nice...

View Article


Reading Delta Lakes into Dask DataFrames

This post explains how to read Delta Lakes into Dask DataFrames.  It shows how you can leverage powerful data lake management features like time travel, versioned data, and schema evolution with Dask....

View Article

Image may be NSFW.
Clik here to view.

Add Category Column to pandas DataFrame with cut

This post explains how to add a category column to a pandas DataFrame with cut(). cut makes it easy to categorize numerical values in buckets. Let’s look at a a DataFrame of people and categorize them...

View Article

Image may be NSFW.
Clik here to view.

Managing Dask Software Environments with Conda

This post shows you how to set up conda on your machine and explains why it’s the best way to manage software environments for Dask projects. This blog post says that Python projects should be set up...

View Article

Image may be NSFW.
Clik here to view.

Splitting Large CSV files with Python

This blog post demonstrates different approaches for splitting a large CSV file into smaller CSV files and outlines the costs / benefits of the different approaches. TL;DR It’s faster to split a CSV...

View Article


7 Steps for rejecting meeting invites

Meetings are the main way to kill your productivity as a creative professional. Two strategically timed meetings can eliminate your makers hours for an entire day. Rejecting meeting invites to protect...

View Article

Self Publishing High Quality Programming Books

This post describes a workflow for self publishing programming books that readers will love. Writing a book seems like a daunting task, but it’s less intimidating if each chapter is “pre-published” as...

View Article


Reading Delta Lakes into pandas DataFrames

This post explains how to read Delta Lakes into pandas DataFrames. The delta-rs library makes this incredibly easy and doesn’t require any Spark dependencies. Let’s look at some simple examples,...

View Article

Image may be NSFW.
Clik here to view.

Testing Pandas Code

This post explains how to test Pandas code with the built-in test helper methods and with the beavis functions that give more readable error messages. Unit testing helps you write Pandas code that...

View Article


Working with PySpark ArrayType Columns

This post explains how to create DataFrames with ArrayType columns and how to perform common data processing operations. Array columns are one of the most useful column types, but they’re hard for...

View Article

Defining PySpark Schemas with StructType and StructField

This post explains how to define PySpark schemas and when this design pattern is useful. It’ll also explain when defining schemas seems wise, but can actually be safely avoided. Schemas are often...

View Article

Renaming Columns in Pandas DataFrames

This article explains how to rename a single or multiple columns in a Pandas DataFrame. There are multiple different ways to rename columns and you’ll often want to perform this operation, so listen...

View Article
Browsing index pages (26 articles)


Latest Images