Hackathon Team 126 (John McCarthy)

Radka Stoyanova (U of Miami), Adrian Breto (U of Miami), Wenxin Zhang (UC Berkeley), Peter Yu (UCLA), David Wong (UCLA), Dan Crichton (NASA / JPL), Steve Skates (MGH), Shirley Li (Abbott), Ben Jacob (RCSI University – Ireland)

One: Evaluate classification performance (cancer / normal) on Moffit dataset using MammoCLIP

  1. CLIP is a Vision Language Model
  2. ? Zeroshot

Mammo-CLIP

Two: Attempt to fine tune:

  1. Convert Moffit data into the correct format for fine-tuning MammoCLIP
  2. Train using 80% training set for MammoCLIP
  3. Evaluate performance on 20% validation dataer

Whiteboard