Lab computational environment setup

• Columbia Neurology HPC cluster guide (private document).
• Install JupyterLab with Script of Scripts suite.
  • An SoS tutorial including how to submit SoS workflows on the Neurology HPC.
• Connect from one computer to another: via JupterLab and VS Code.
  • Script to setup and run Jupyter server on cluster.
  • A short VS Code tutorial.
• Singularity tips.
• HPC cluster job submission tips.
• Computing using AWS and MemVerge.
• SoS debug tips.
• Columbia Medical Center VPN.
• Columbia Medical Center Wifi.
• Computing FAQ from the lab.

MacOS setup

• A short note on setting up a new Mac OS for work (Last updated: 2023).
  • Singularity on Apple Silicon chips.

Linux setup

• An automated installation script written in SoS workflow (Last updated: 2022).
• Linux Mint setup (Last updated: 2020).
• Debian / Ubuntu setup (Last updated: 2015).

HPC computing

• Sun Grid Engine cluster for beginners, from MDC.
• Commonly used commands on HPC cluster.
• Use tmux to manage multiple interactive sessions.

Data access and sharing

• Download from dbGaP.

Software development tips

• Automatic package versioning in R for packages you develop.

Command line tools

• Monitor memory usage for a command line program.

AI tools

• Useful ChatGPT 4 prompts that we create and tested to work well in practice.

Other productivity tools

• obsidian, I find it useful for notes taking and outlining ideas.
• VS Code text editor for coding and writing Markdown files. It has Vim Keybinding extensions.
• Create multi-panel figures for presenting your daily work.

Programming tips

• Python tips.
• R tips.
• Bash one-liner.
• Learn regular expression interactively.
• A list for effective computing, from Peter Carbonetto.
• An example R package (with Rcpp extensions), from Peter Carbonetto.