Projects

A collection of non-research projects I've worked on over the years.

  • I also tweet and blog about my projects!
  • Some slides from a talk I gave a few months ago on how I use LLMs (for research, clinical practice, and programming).

Some (current) personal favorites:

  • Clinical AI:

    • * Osler: a workspace + copilot for physicians writing H&P notes that is designed to augment thinking, not replace it. (More information)
    • * Pearls: an app for capturing clinical pearls while on rounds or studying, with built-in AI agent that can automatically fetch additional context, latest guidelines, and augment the pearl (More information)
    • MedQA: a GPT-powered clinical reference tool that can answer clinical questions and follow-up questions in natural language, along with references to sources.
    • clinitokenizer and clinisift, BERT-based off-the-shelf tools for medical sentence tokenization and Named Entity Recognition, respectively
  • AI Software:

    • Museum Music, an app to use in museums, that dynamically updates a Spotify playlist with period-appropriate music by taking a photo of the art you’re viewing! Built with GPT-4-Vision and Spotify API.
    • Memcast, capture interesting parts of a podcast with just a screenshot! If you hear something interesting on a pod, but don't want to stop to write it down, just take a screenshot! Memcast will use it to auto-identify pod, episode, and timestamp.You'll get summarized bullet points from that timestamp, logged to your memcast notebook πŸ“’. Built with Whisper, GPT-4-Vision, GPT-4.
  • Emacs:

    • emacs-secondmate, a "mini-imitation" of GitHub Copilot for Emacs via HuggingFace Transformers
    • gpt-emacs-macro, running "semantic macros" in Emacs via GPT-3 (and a blog post on Semantic Macros in Emacs)