Summer Chang built a travel language agent that helps you practice ordering food in Japanese. It retrieves your dietary restrictions from memory, generates speech in Summer's voice using ElevenLabs, and responds to your orders in Japanese. The demo shows it handling allergies and custom requests like adding egg to ramen.
Hi, I would like to share with you my hackathon progress.
I started at 8:00 AM San Francisco time. Right now it's 7:00 PM. You can see it's dark outside. So this time it's a team of one. I'm building a travel language agent that connects with ElevenLabs with Supabase to remember my dietary restrictions and order food in Japanese. Then I will build the interface in Laravel and connect All of them together. So here is what it looks right now, agent with memory.
Where I started, I started with a text input, the agent going to search for the information, and then going to search for my memory and connect it to Superbase vector. So let me show you the test. I'm gonna test the chat. I say hi. Okay, it doesn't make— okay.
Hi.
So let's try this test step. Run here. It's working. So let's open the chat again. I want to order ramen and green tea in Japanese. Enter. So then it tells me, okay, here, to say ramen in Japanese. Ramen, rōyūkucha. Maybe I butchered that.
Hi, what would you like to order?
I would like to order spicy ramen and green tea, please.
All right, spicy ramen and green tea it is. In Japanese, that's shin ira mentolucha kara ramen toriyoku cha o onegaishimasu. Would you like me to repeat that or save it for you?
Uh, I would like to add some toppings to my ramen.
No problem. What toppings would you like to add? Let me know and I can help you say it in Japanese.
Yes, I would like to add some egg and vegetable.
To add an egg and vegetables, you can say "ルアンとゆえかいを注意してください。卵と野菜を追加してください。" Would you like to hear that again, or should I save it for you?
And I'm allergic to onions.
Okay, I understand. Being allergic to onions can be tricky. To let them know you're allergic, you can say "ユネギアレルギーがあります。" Tamanegi ararugi ga arimasu. That means I'm allergic to onions. Would you like me to repeat that or save it for you?
Okay, that's it. I would like to show you my configurations for the ElevenLabs, what I have so far. So here, actually, maybe you can tell that was my voice. I recorded my voice and uploaded to the voice section, so it's Summer's voice. And then I choose English. I input the first message. So when I call the agent, the agent will get back to me. So I put assistant prompt, you are friendly travel safety AI assistant helping users to practice ordering food in Japanese restaurant. So, and then for each interaction, ask the user what they want to say or practice and ask them if they want to hear again or save it later. So give an example. And then tell them, oh, this is a tool I'm using. So yeah, basically just like that. And then the tool section, I add an AI as a tool. And then the body, and I'm still trying to figure out how to connect all of them together and connect it to the Rock Agent. So if you know, show me and let me know what I did wrong. And have a great weekend.
