DEEP PERCEPTION HACKATHON

The first MLT Deep Perception 2-day Hackathon was held on September 14-15 2019 at Mistletoe of Tokyo and attracted more than 50 participants, volunteers and mentors. The goal of this hackathon was to blend Deep Learning into VR/AR/MR environments and find innovative and creative ways to combine those technologies. It was co-organized by the Digital Nature Group (The University of Tsukuba) and supported by ON-1 Tokyo.

Invited talks and workshops

On September 14 we had several invited talks and workshops throughout the day that helped participants to get up to speed in XR, including hardware and software setup. Since most of our participants were Machine Learning and Deep Learning engineers this was a great opportunity to deep dive into technical details but also get inspired by application and use cases shown.

–  Intro to VR/AR/MR, Bektur Ryskeldiev (Digital Nature Group)
–  Oculus Rift, Yohance McDonald (Robot Club)
–  VR/AR/MR in Industry Applications, Imre Vekov
– Augmented Reality and Artificial Intelligence, Mark Billinghurst (Empathic Computing Lab, University of SouthAustralia)
–  Perception Neuron Motion Capture Suit, Takashi Jona (Noitom)
–  XR in Healthcare, Naoji Taniguchi (CEO Holoeyes)

Demos

The teams were composed of members with diverse backgrounds such as Deep Learning, Robotics/Hardware, VR/AR and Design. They presented their projects and demos that span Deep Learning in VR and AR applications, such as the Kanji Puzzle, an interactive kanji learning tool in VR, Martial Arts in VR with Body Tracking, GauGAN painting in VR and a Space Tag AR app that tags specific places with more information.

Screen Shot 0032-02-18 at 12.25.45

Application (ended)

Machine Learning Tokyo, the Digital Nature Group at the University of Tsukuba and ON-1 Tokyo are organizing a Deep Perception 2-day Hackathon to combine Deep Learning with interactive AR/VR/MR environments. The goal is to explore both fields and find novel ways of synthesis and interaction. We’ll have teams of 3-5 people with different technical and creative backgrounds to work on diverse project ideas which will be presented at the end of the hackathon. The event will be held at Mistletoe of Tokyo.

Explore different VR hardware like HTC Vive, Oculus RIFT, Windows Mixed Reality Headset, Microsoft HoloLens and complementary hardware like the Jetson Nano.

🛑 –– APPLICATION: OPEN UNTIL SEPTEMBER 7 –– 🛑
We have 40 open spots for engineers, artists and designers. The application form is open until September 7, accepted participants will be notified on September 8. Please apply here in this form: https://forms.gle/fFv3UBXFwfjC19R8A

 

Organizing committee

Screen Shot 0031-08-13 at 9.01.53Screen Shot 0031-08-13 at 8.55.49ON-1-NO_black

Venue partner

logo2

Hackathon partners

 

  ROBOT CLUB

 

💡 –– SCHEDULE ––

🤖 DAY 1 | SATURDAY, SEPTEMBER 14

9:00 am – Welcome note
9:30 am – Team building and start hacking
12:30 am – Lunch break
5:30 pm – Invited talk and Q&A
8:00 pm – Closing Day 1

🤖 DAY 2 | SUNDAY, SEPTEMBER 15

9:00 am – Start hacking
12:30 am – Lunch break
5:30 pm – Project Presentations
6:30 pm – Dinner & Drinks
7:00 pm – Announcing winning teams
8:00 pm – Closing Day 2

 

 

💙 –– THANK YOU ––
A huge THANK YOU goes out to Mistletoe of Tokyo for hosting this event. Mistletoe of Tokyo is a place to connect with people who are searching for a better world and thinking about the future. https://mistletoe.tokyo/about/

Shout-out to ON-1 and SVSING for the media creation!

Videography: ON-1
Photography: SVSING

–– MLT PATRON ––
Become a MLT Patron and help us to keep MLT meetups like this inclusive and for free. https://www.patreon.com/MLTOKYO

–– FIND ML RESOURCES ––
Github: https://github.com/Machine-Learning-Tokyo
Youtube: https://www.youtube.com/MLTOKYO

–– RECRUITING ––
MLT events are for community building and knowledge sharing. We politely ask that company representatives, recruiters and consultants looking to hire or sell their services do not come to this event.

Main image source: https://www.stambol.com/2018/05/28/the-future-of-ar-vr-headset-design-is-hybrid/

Leave a Reply