A collection of snippets and functions that I regularly use in my workflows as a data scientist. These snippets are utility functions that speed up my work, and focus on Pandas, Numpy and visualization libraries.
| Snippet | Code | Description |
|---|---|---|
| Code | This function improves the value_counts function by outputing absolute and normalized counts simultaneously, for faster analysis. It also sets the default value of dropna to False, so any NaNs that exist easily spotted. |
|
| Code | Pandas isn't great when it comes to handling large amounts of data, mainly because it natively uses only a single core. Pandarallel is a very straightforward alternative to parallelize pandas code. |
| Snippet | Code | Description |
|---|---|---|
| Code | Coloring specific values in your output can be an easy way to highlight important information. While there are packages like termcolor or colorama, I find that simply using ANSI color outputs works best. |
|
| Code | tqdm is a package that lets you create progress bars. While it has notebook specific versions via tqdm_notebook, I find that directly using tqdm works just as well without the hassle of setting up ipywidgets and IProgress. |