Age: 18San Jose, CA
Category: Technology/Artificial Intelligence/Computer Vision/Deep Learning
Amy Jin is an 18-year-old student from San Jose, California. Ever since she was introduced to computer science and artificial intelligence, she has been fascinated by their ability to serve as interfaces and tools to explore various disciplines. She believes in harnessing their power for social good. Amy is extremely honored to be a Davidson Fellow and to be a part of such an inspiring, passionate group of peers. She is grateful to the Davidson Institute for giving her the incredible opportunity to share her work and for supporting her pursuits in computing and technology.
Amy’s project uses deep learning to recognize and track surgical instruments in videos, enabling rich analysis of tool movements and usage patterns to automatically assess operative skill. Given that approximately half of all surgical complications are avoidable, many of which are attributed to poor individual and team performance, it is crucial to provide individualized training and targeted feedback to surgeons to improve surgical care quality. However, evaluating operative performance requires expert supervision and is a manual process that is time-consuming and subjective. Thus, Amy leveraged region-based convolutional neural networks to facilitate operative skill assessment, extracting visual assessment metrics such as tool usage timelines, motion heat maps, and tool trajectory maps.
Amy began her journey in AI in 2015 when she attended Stanford AI4ALL, a summer program that engages young women and underrepresented minorities in the field. Exposed to different branches of AI from robotics to natural language processing, Amy was struck by the field’s remarkable versatility for real-world application. At AI4ALL, she also worked on a computer vision-based hand hygiene monitoring system to combat hospital-acquired infections. This firsthand experience motivated her to learn more about AI and conduct research in AI-assisted healthcare. After the program ended, Amy reached out to her AI4ALL mentor Serena Yeung, asking how she could further pursue the field, and she started working on her project in 2016.
Amy’s work could not have been possible without the continuous guidance and support of her mentors, Dr. Serena Yeung from the Stanford Computer Vision Lab and Dr. Jeffrey Jopling from Stanford Medicine. Amy is endlessly inspired by their dedication and passion, and she feels lucky to have such amazing role models to look up to. With their mentorship and encouragement, Amy was able to tackle the challenges that she faced while working on her project, whether it was determining an automated approach to analyze operative skill based on tool usage information, or collecting a new dataset and training a model for this previously unstudied task of spatial tool detection in laparoscopic videos. Amy is also grateful to Professor Fei-Fei Li, Professor Arnold Milstein, the Stanford Artificial Intelligence Lab, and the Clinical Excellence Research Center for this research opportunity. Additionally, as an alumna of AI4ALL, Amy is thankful for the entire AI4ALL community. She is inspired by the seeds of the movement that AI4ALL has sowed — an unwavering push for diversity and inclusion in AI and for the ethical development of cutting edge AI technologies. She hopes to one day not only witness but also advance its growth.
The rigorous classes that Amy took helped her build a solid foundation to conduct her research as well. From taking advanced math and computer science classes at school, including multivariable calculus and expert systems, to studying Stanford’s computer vision and deep learning courses under Serena’s guidance, she enjoyed seeing how fundamental concepts she learned applied to her research and could be applied to devise creative solutions to challenging problems. A recent graduate of The Harker School, Amy would also like to acknowledge the faculty and administration for providing a stimulating academic and extracurricular environment from which she benefited immensely. Her teachers and peers instilled in her a love of both exploring widely and diving deeply into her interests. She thanks Ms. Anita Chetty and Mr. Chris Spenner for greatly influencing her development as a leader, researcher, and community-minded individual. Amy will be attending Harvard University in the fall, where she hopes to continue pursuing her interest in computer science and take courses in a breadth of subjects, including ethics and philosophy.
Where do you see yourself in 10 years?
Working as a researcher or entrepreneur at the intersection of artificial intelligence and healthcare.
If you could have dinner with the five most interesting people in the world, living or dead, who would they be?
Sheryl Sandberg, Elon Musk, Atul Gawande, Leonardo Da Vinci, Nikolai Rimsky-Korsakov
What is your absolute dream job?
Collaborating with people from different disciplines to responsibly develop AI technologies that tackle challenging problems and address societal needs
If you were a wrestler, what would your entrance song be?
'September' by Earth, Wind, & Fire
Aside from necessities, what's one thing you could not go a day without?
What lame superpower would you want?
Ability to understand and communicate in every language.
If you could be on any TV show, which one would it be?
World of Dance
What is your favorite food?
Say you're independently wealthy and don't have to work, what would you do with your time?
I would visit developing countries and establish smart hospitals where there are inadequate healthcare facilities.
Which skill would you like to learn?
What is your favorite tradition or holiday?
Weekend hikes with family and friends.
In the News
SAN JOSE TEEN AWARDED $50,000 FOR COMPUTER VISION PROJECT ASSESSING OPERATIVE SKILL
Amy Jin to be Named a 2018 Davidson Fellow
Click here to download the full press release
Click the links below to see hi-res photos of Amy:
Started in 1999, the Davidson Institute for Talent Development is a 501(c)3 private operating foundation. Our mission is to recognize, nurture and support profoundly intelligent young people ages 18 and under, and to provide opportunities for them to develop their talents to make a positive difference.
Profoundly gifted students are those who score in the 99.9th percentile on IQ and achievement tests. Read more about this population in this article.