Articles in the College Productivity category

Preliminary list of stuff to do by your 30th birthday

Posted in College Productivity

Here's a post I've been wanting to do for a year or two. My 30th birthday is in a handful of days, and so I wanted to write down everything that I think has been really beneficial to me in getting habits and routines down in my 20s. In the …

Pytables

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

A previous post covered HDF5 files, and mentioned that they offer the ability to append rows of data as an experiment is in progress. In this post, we'll cover a library specifically designed to use this feature. The name …

HDF5 Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python. HDF stands for hierarchical data files, and HDF5 was a standard that was developed to allow massive data sets to be stored and read in a computationally and space-efficient way. HDF5 files can be very complex and typically require …

Compact Allan-deviation Code

Posted in College Productivity

This is a quick little code snippet that claculates the Allan deviation of the input data.

import numpy as np
def oadev(data, rate, numpoints=30):
    x = np.cumsum(data)
    ms = np.unique(np.logspace(0, np.log10(len(data) / 10), numpoints).astype(int))
    oavars = [((x[2*m:] - 2*x …

How to denoise a 1-D signal with a Kalman Filter with Python

Posted in College Productivity

I frequently need to denoise a signal that is the sum of a noise and drift process. I'm going to provide a quick little Python tutorial (with some code you can copy-paste) that you can use to denoise noise and drift in your experiments.

Let's suppose we have some measurement …

Numpy Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

In this post, we'll be covering .npy and .npz files. NumPy is short for "Numerical Python", which is the library for handling arrays in Python.

Let's suppose that we have some dataset which consists of one million random 64-bit …

CSV Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

In this post, we'll be covering .csv files. CSV stands for comma-separated values. If you've ever worked with spreadsheets, you know what these are.

CSV files are ideal for saving data that you may have taken by hand and …

JSON Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

In this post, we'll be covering .json files. JSON stands for JavaScript Object Notation. This is the format that a lot of data is passed around on the internet, and is an extremely common way of storing information in …

YAML Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

In this post, we'll be covering .yaml files. YAML stands for "YAML Aint Markup Language", and it's a nice way for humans to read and edit several properties of some thing (e.g., an experiment, a piece of hardware …

Text Files

Posted in College Productivity
file formats

This is part of a series on data storage with Python.

In this post, we'll be covering plain .txt files. This is the most generic way to store data as it is very easy to edit (using any text editor), but it is also the least structured. Text files are …

Page 1 / 3 »


Christ-follower, brother, husband, father, grad student.

Pages
Categories
Tags