How iLingual Uses Computer Vision AI to Translate and Learn Languages
Omar Alexander Abbas and Raymona Singh are the creators of iLingual, a free app that enables users to learn languages by bringing together machine learning and language translation. We recently got to speak with Omar about his work and use of Clarifai. Check out the interview below!
We'd love to learn about you and Raymona! How did you get to where you are today?
Hi, I’m Omar! I was born and raised in NYC, and I'm a recent-ish graduate from Baruch College. I majored in Economics but found a knack for coding during my last semester. It honestly all started by wanting to understand what’s happening beneath the surface of all these things we use in our daily lives.
I started off learning Python through YouTube videos, and when I eventually wrote my first few lines of code that printed “Hello world,” I was hooked. After I had a few more languages and a decent amount of jargon under my belt, I started reaching out to more experienced developers, reading textbooks/articles, and practicing whenever I could. The world of coding is a constantly changing environment, so it’s always exciting to see what’s around the corner. I've created a few apps so far, but besides this I'm always open to learning new things relating to the fields of physics and philosophy.
Raymona, my partner-in-crime, moved to NYC a few years back and also graduated from Baruch with a major in Philosophy. She's working her way to law school and pretty much enjoys anything related to the tech field. She's the type of person you go to when you want to have a conversation about Robot ethics--that's the best way to sum it up.
What is the name of your application, and what does it do?
iLingual is a modern way to learn a new language. We incorporated artificial intelligence like photo and voice recognition so users find it more convenient to access real-time language translation. The process is simple, you either select a photo from your library, snap a photo, or use your camera for real-time detection. The AI predicts what it sees and gives the user their desired language translation in both text and speech.
Why did you build this app, and what inspired you? Tell us about your “Eureka!” moment.
We were basically testing out photo recognition for the fun of it and the idea of language translation developed as we went along. We started promoting it on various social media platforms and people seem to be really interested in it, so we are constantly improving it.
Love that you're constantly improving the app. What tweaks have you made since the launch?
A bunch! In terms of behind the scenes tweaks, we’ve worked on reducing the app’s energy consumption to avoid straining battery life. We’ve also moved a lot of the network related processes to our end. So in the situation a user is on a limited data plan, they won’t have to worry. Another big one was the size of the app. We didn’t want to be the first to the gauntlet when the “Storage almost full” alerts appear. On the user-facing side, we’ve worked to keep everything modern and user-friendly. We looked for ways to integrate the recurring design/functionality trends that other apps were adopting.
How did you build it? What programming language did you use? What about other tools?
The app is built and maintained using Xcode and Swift. Behind the scenes, we have Firebase as our back end written all in Node.js.
What was the best part about working with the Clarifai API? Did you compare the Clarifai API to other image recognition services? If so, which ones?
One of the first features we wanted to implement was image recognition language learning. It was our first toe dip into the world of AI, so we didn't know what to expect. We shopped around but found that most APIs were lacking in something, IBM Watson was offline and free but too large, Google was relatively complex but pricey, and like Goldilocks in the middle bed, Clarifai was there. Not to get all infomercial, but it was a breeze setting up. Also, iLingual would result in a high amount of recognition usage, and Clarifai offered flexibility as far as pricing, so that's always a plus.
Anything else you’d like us to know about or share?
We're going to be releasing a speech to text update soon, it'll allow you to create a transcript in almost 60+ languages of practically any video you find online. That includes Instagram, Twitter, YouTube Facebook, etc. After that, there will be a museum update, so be sure to stay in touch!
Thanks for sharing, Omar!
To try out the app, download it for free here.
Want to connect with the iLingual team? Follow along the app’s adventures on Twitter and/or Instagram and don’t forget to give some props to Omar + Raymona.
To learn more, check out our documentation and sign-up for a free Clarifai account to start using our API – all it takes is a few lines of code to get up and running! We’re super excited to share all the cool things built by our developer community, so don’t forget to tweet @Clarifai to show us your apps.
相關推薦
How iLingual Uses Computer Vision AI to Translate and Learn Languages
Omar Alexander Abbas and Raymona Singh are the creators of iLingual, a free app that enables users to learn languages by bringing together machine learning
Don't Fear AI: Embrace It And Learn What It Can Do For Your Business
"The development of full artificial intelligence could spell the end of the human race," Stephen Hawking told the BBC a few years ago. Elon Musk has delive
How to Prove the ROI of Computer Vision Moderation
While other forms of AI are still in their infancy, one field of AI is already in practical use by businesses: computer vision. Computer vision (CV) has al
How Healthcare Industry Uses AI to Better Meet Patient Needs
AI has the potential to transform healthcare. And in few places is that potential greater than in fast-growing China, home to one of the world’s largest el
From feature descriptors to deep learning: 20 years of computer vision
From feature descriptors to deep learning: 20 years of computer vision 搬到牆內 時間 2015-01-20 23:45:00 tombone's blog 原
1.Intro to Deep Learning and Computer Vision
Intro 這是Kaggle深度學習教育課程的第一課。 在本課程結束後,您將瞭解卷積。 卷積是計算機視覺(以及許多其他應用程式)中深度學習模型的基本構建塊。 之後,我們將很快開始使用世界一流的深度學習模型。 Lesson [1] from IPython.displ
How Thomson Reuters and IBM are bringing AI to data privacy professionals
In today's world, data is the new basis of competitive advantage – and businesses are paying close attention to how they use their data, especially highly-
How IBM wants to use Watson AI to reduce bias in hiring
On Monday, IBM announced the launch of Watson Recruitment's Adverse Impact Analysis capability, a feature that uses artificial intelligence (AI) to help co
How Microsoft Uses Machine Learning to Help You Build Machine Learning Pipelines
Last week at its Ignite Conference, Microsoft unveiled the preview version of Automated Machine Learning(ML), a component of Azure ML that allows non-data
How Google Is Using AI To Power Internal Talent Deployment
The traditional narrative when it comes to discussing the impact of artificial intelligence on HR revolves around the jobs that will be lost. It's a largel
Video: Pathology Test Uses AI To Predict Prostate Cancer Progression After Surgery
Houston, Texas, USA: A pathology test that applies artificial intelligence (AI) to characterize tissue samples can accurately predict clinically significan
How Facebook Uses Bayesian Optimization to Conduct Better Experiments in Machine Learning Models
How Facebook Uses Bayesian Optimization to Conduct Better Experiments in Machine Learning ModelsHyperparameter optimization is a key aspect of the lifecycl
Beyond text: How Spokata uses Amazon Polly to make news and information universally accessible as real
This is a guest blog post by Zack Sherman, Founder of Spokata. In their own words, “Spokata is a mobile audio platform that streams real-time news
Babysitter screening app Predictim uses AI to sniff out bullies
If you're a parent with young kids, you probably know how arduous it can be to screen a babysitter. And among those who have hired one, a whopping 62 perce
How to Put AI to Work
Summary: Whether you are a startup person or data science-minded executive in a larger organization what logic can you apply to spot the most compelling o
How Microsoft plans to use AI to impact the entertainment industry
Artificial intelligence (AI) tends to divide public opinion; some favor the developments made in tech, while others worry we've gone too far. Tony Emerson,
AI — Python Computer Vision Tutorial with OpenCV
AI — Python Computer Vision Tutorial with OpenCVAI — Python Computer Vision Tutorial with OpenCVWhat is Computer Vision in Python?Computer Vision is a fiel
What’s New in Deep Learning Research: How Google Uses Reinforcement Learning to Ask All the Right…
What’s New in Deep Learning Research: How Google Uses Reinforcement Learning to Ask All the Right QuestionsThe ability of formulate questions is a fundamen
How semiconductor companies are adopting IoT and AI to drive new revenue growth models
The semiconductor industry is one of the fastest growing sectors in technology. Information provided by the Semiconductor Industry Association (SIA) reveal
What is Computer Vision & Why Should Businesses Care About This Form of AI?
At its most basic, computer vision (CV) is a form of artificial intelligence that enables computers to see. Today, we expect technology to be able to read