I Upgraded My Car With Open-Source AUTOPILOT and it's AMAZING

🚀 Add to Chrome – It’s Free - YouTube Summarizer

Category: Technology Review

Tags: Automotive TechDIY InstallationDriver Assistance SystemsOpen Source TechnologySelf-Driving Cars

Entities: Galaxy Note 9KA 3XOpen PilotSnapdragonTeslaToyota CorollaVandrewVantrew

Building WordCloud ...

Summary

    Introduction to Self-Driving Technology
    • A five-year-old Toyota Corolla is transformed into a self-driving car using the KA 3X and Open Pilot software.
    • The technology allows the car to function similarly to a Tesla with autopilot but at a much lower cost.
    • Vantrew sponsored the video by providing dash cams to capture the installation and driving experience.
    Installation Process
    • The installation of the self-driving system is straightforward and can be done in under an hour.
    • The process involves connecting the system to the car's OBD port and mounting the device on the windshield.
    • The system uses a Snapdragon processor and features such as LTE, Wi-Fi, and GPS.
    Performance and Functionality
    • The Open Pilot software allows for adaptive cruise control and lane-keeping features.
    • The system struggles with certain maneuvers, such as sharp turns and roundabouts, and requires driver intervention.
    • It performs well on highways, maintaining smooth braking and acceleration.
    • The technology is open-source, enabling community-driven improvements and customizations.
    Legal and Safety Considerations
    • Users should check local laws regarding windshield-mounted devices, as some jurisdictions may restrict their use.
    • The system is designed to work collaboratively with the driver, allowing for manual adjustments.
    Future Potential and Recommendations
    • The video suggests potential improvements, such as integrating navigation data for better performance.
    • The creators plan to conduct a long-term review and explore additional software options.

    Transcript

    00:00

    Oh my god. Oh my god.

    Look at it go. It's driving itself.

    Driving itself. Are you touching the gas?

    No, I'm not touching anything. And guys, this is no Tesla with autopilot or whatever.

    It's not a Whimo. This is like a 5-year-old Toyota Corolla.

    00:16

    Oh, it needs a little help. It needs a little help.

    Oh. Oh, look at it go.

    Look at it go. It might smell a bit like mold, and it definitely isn't much of a looker.

    But with the help of this incredible piece of technology, the KA 3X, and the open- source self-driving software it runs

    00:33

    called Open Pilot, this practical commuter car is now in the same class of self-driving as a base Tesla with autopilot, making it into one of, if not the cheapest self-driving cars on the market. I've wanted to drive this guys for so freaking long.

    And thanks to

    00:50

    Vantrew, who sponsored this video, sending over a bunch of their dash cams, I'm going to have all the angles when we show you guys exactly how easy it was to install and what it feels like to have what is fundamentally a cell phone drive your car for you. And did I mention it's open source?

    01:05

    You did, but it's cool enough to mention it twice. There's no way that this is it.

    That is it. This is the 3X.

    And this black box contains everything we need to turn the car I'm sitting in self-driving. Make driving chill.

    Oh my god, that's a

    01:21

    lot of fine print. Let me Let me read the fine print.

    Oh, it actually says fine print. Oh yeah, this is the bulk of the hardware.

    And it's basically a phone with a Snapdragon processor, 128 gigs of built-in storage, a 2160x 1080 OLED display, USB 3, and of course, LTE,

    01:38

    Wi-Fi, and GPS. The wild part though is that it's not even a high-end phone.

    Like, it's about on par with my old Galaxy Note 9 in terms of the performance. What isn't on par with the Galaxy is, of course, the cameras.

    It has two 180° lenses, one here and then

    01:54

    one on the back in order to give it a 360° view and then also has a narrow field camera to see far ahead. It's cool that it's got the Kama logo on the back.

    Yeah, they actually do all the electronics assembly and design in the USA. And they even have their own SMT line in their office where all the

    02:10

    circuit boards are made. So, this hardware is fully custom.

    And apparently, they can make up to 500 of these things a week. Now, it's not cheap.

    I mean, $1,000 is uh is a pretty hefty price to ask for like a Note 9 tier hardware, but they are operating on a really small scale. And on a hardware

    02:26

    product that's made in the USA and fully custom, well, it seems pretty reasonable, especially when you consider the software development that goes along with a hardware product. I mean, it's open source, but they're pushing most of it.

    And to their credit, they are costing down the product over time rather than

    02:42

    the other way around, which goes against the industry trend. This used to be more expensive.

    You don't get a ton in the way of accessories. We've got a Toyota A adapter harness.

    Yep. USBC, which just goes right into there.

    The right angle USBC here. That's what connects to the car.

    And then what is this?

    02:57

    Uh, that also connects to the car, but it's technically optional. That's like the power adapter.

    So, if you have this in your car and you want it to be like uploading training data at night, you need that. That keeps it powered.

    Oh, super cool. You can also GPS track your car with that plugged in and it off and like remotely check in on it.

    Oh, that's super like a Tesla. You have

    03:12

    to pay money for that. We'll get into that later.

    So, this is all we need. Yeah.

    All you need because I don't think it's fair for me to try to install this. I work on cars all the time.

    I want to see how a normie would do it. There's instructions.

    They're not specific to this car, but there's instructions. Cool.

    Step one, remove the rearview mirror

    03:29

    cover trim. This is where I'm gonna stop you.

    Wait, wait, wait, wait, wait, wait, wait. Step one, I don't care.

    So, like I said, I work on cars. I don't know why these instructions don't include this, but step one of working on any car's electronics is disconnecting the battery.

    It probably doesn't matter. And

    03:45

    to be clear, for our use case, I'm actually not going to do it because I want to see what happens. But if you're doing this at home, you bought this thing, just disconnect your battery first.

    Wait, wait, stop for a second. Trim tool.

    No, I got it. No.

    Damn it. There's a sponsored thing.

    You Luckily, our sponsor, Vandrew, includes a little trim tool with their

    04:00

    dash cam, so you can use that to get it off. It said to slide down, I think.

    Oh, here. This part.

    Take this part off. Boom.

    There we go. And then now I'm supposed to do it.

    Oh, sorry. Yeah.

    Hey, how you doing, buddy? Connect car harness into the camera.

    Oh, so I am

    04:16

    disconnecting my existing camera. You're putting it in line.

    To be honest, I don't know if it actually talks to that part of the car at all. It definitely doesn't like analyze the feed, that's for sure.

    I did see on like a Reddit post that someone said on cars that have blind spot monitoring that it will stop a lane change if it gets

    04:33

    detected on there, but I don't know if that's supported on all the cars. That is kind of the thing about open- source solutions is yeah, it's got a feature set, some of which may be implemented.

    Yeah, to their credit, a lot of it is just reverse engineering. Like they just have to basically around and find out.

    04:49

    Yeah. Well, look here.

    We got a little connect jig. Uhhuh.

    And then we put our other connect jig right where that one was. Okay.

    Oh, yeah. There we go.

    We plug this guy into here. Got a little bit of VHB tape.

    Oh, they've even got a nice little pulley tab for me on it. Thanks,

    05:04

    Ka. I don't know if this spot's going to work, but I stuck it there.

    This is killing my back sitting in here like this. I'm getting so old.

    Damn it. Where's the other?

    All right. Here we go.

    Now I get in here. Am I doing wearing a sweater?

    LTDstore.com. LTDstore.com, baby.

    Now, we're going to

    05:21

    plug our power cable into the car's OBD port. A little something like that.

    So, I'm kind of thinking we'll come across this way. Yeah, buddy.

    Now, I'm going to plug in this power connector. Okay, here's the other side of this power connector.

    We're going to cable manage this a little bit later. And then now

    05:37

    we're going to use Ka's got this funky USB cable that improves the clearance for the back of the unit here. See, it kind of it's right angle, but it's like going off a weird wonky way.

    So, we're going to plug the other end into right here. Now, I just got to find somewhere

    05:52

    to put this. And honestly, there's not a lot of room.

    Oh, bud. She's on.

    She's not going anywhere. I don't think I managed to get the VHB tape attached to anything, but it's stuffed in there so tight, I don't think it's going anywhere.

    Step three, place mount high and

    06:09

    centered on the windshield. It looks like you already did that.

    Yeah, you're supposed to let it cure for 48 hours, so I stuck it on a little early. Make sure all lenses are free of debris.

    Oh, look at that. I should have got you the Apple polishing cloth.

    No, you shouldn't have. Now, all we got to do pop this bad boy on here.

    And then

    06:26

    this slides into our mount. A little something like There we go.

    Boom. Just like that.

    Step five, reinstall the rearview mirror cover trim. Oh, I already did that.

    So, I'm done. Pair your device with Comet Connect.

    All right, let's do the

    06:41

    setup guide. This is one of those cases where I might actually recommend connecting to 2.4 GHz just because your reception might not be great in your garage.

    It'll just kind of depend on where your access point is. I think I can probably do 5 GHz, but your mileage may vary.

    Yeah. Or hotspot your phone.

    Choose software to install. Okay, we're

    06:57

    going to do open pilot this time, but there's actually, you know, like any open source project, lots of people who have other ideas for how it should work and various forks that have their own strengths and their own potential weaknesses. Yeah, some of them look very compelling and we will try that later.

    We're

    07:13

    actually planning to do a long-term review as well where we try a couple different cars. I really want to see how it is compared to Tesla's built-in basic autopilot u and maybe full self-driving.

    I don't know. And then we also want to look at the other software options because apparently some of them are really good and like add things like you can make it so it follows really

    07:30

    closely. Say you're in LA traffic and you don't want people cutting in front of you.

    Follow like a dick but with the computer. That's pretty cool.

    We should actually have a few different drivers try it potentially. Get subscribed so you don't miss it.

    Oh, is it almost done? Oh, it's doing a software update now.

    So there is an operating system on it right now. Obviously I can't remember what it's

    07:46

    called but it's Linux based and what it's installing right now is it's it's kind of like an app basically but that app takes over everything. I can't believe how painless this was.

    Like even filming it, you know, so redoing takes and all of that. Dude, we've been here less than an hour.

    Oh yeah. Like this is very just Yeah.

    DIY. You

    08:03

    just chuck it in your car. If you watched a video of somebody else doing it beforehand and you had all the cables ready and you knew how to take that thing off, you could do this in 10 minutes.

    Before we drive, we're going to sign in and we get what? Remote access, 24/7 LTE, a year of drive storage, and remote snapshots if you pay for it.

    08:18

    Oh, is there a benefit to signing in if you don't have a Prime subscription? It allows you to look at your drive videos for like the last three days.

    That's what they'll keep for you. Kind of like a dash cam.

    Or you can pay a certain amount of money to get all of those features and a data connection. Or you can pay like 10 bucks a month to get all

    08:33

    those features and you use your own SIM card. I don't think that the one including data even works in Canada.

    But why would you pay for a subscription for like dash cam functionality when you can just get a dash cam from our sponsor, Vanru? We have their Nexus 4 Pro S here, which is their new dash cam.

    has triple

    08:50

    channel recording, including 4K on the main channel. It's got a remote third camera that's waterproof.

    You could even put it outside. So, you got like a big sprinter van, you could stick it on the outside as like a rear view camera if you wanted.

    They use Sony Starvis sensors. You can use their plate pick thing to have better clarity for license

    09:06

    plate stuff. It's got GPS.

    It's got LTE if you want it with an add-on. It's kind of the bees knees.

    And they also gave us a few more. We've got the E1 Pro down here, which is a single lens camera.

    Uh, and then there's another one at the back that's a 360 camera that even has a like

    09:23

    a 360 action cam mode. You can take it out of your car and use it like a 360 cam if you want.

    Cool. So, thanks to Vantry for sponsoring this and we'll have a bunch of footage of the drive because of them.

    Okay, sure. Yeah, I'll open the fire hose.

    Yeah, give them that just means it uploads more data for them to train.

    09:38

    It's an open source project, but it's also a like distributed training pool. So, when you drive, even when you're not using Open Pilot to drive for you, it's recording and it can upload clips.

    And they even allow you, if you want, depending on your privacy settings, to upload the driverfacing camera data if

    09:54

    you want to help train their driver attention models. I enabled that.

    Normally, I would not ever put my seatelt under my arm. You're not supposed to do that, but my microphone is here.

    So, yeah. Are you scared?

    You seem like a bit tense. I'm a little tense.

    If we die, there's going to be so much footage of it. Here

    10:11

    we go. Okay.

    Drive above 15 mph. It's Canada, you Oh, yeah.

    Let's change that. I'm finding the interface really intuitive.

    You just tap it and then it brings up the the settings cog and then you just Uh-huh. Use metric system.

    10:26

    Look at that. Let's go.

    We'll just do aggressive driving personality. No, standard.

    Let's start with standard. Whoa.

    See, look. It's already charting the course.

    Well, let's get out to the road. So, it's very important that when you mount this thing that you put it centered, otherwise your car will like lane keep

    10:41

    off center. Okay.

    Okay. Calibration in progress.

    98%. So, that looks pretty good.

    Oh, my lanta. Oh, Jesus.

    Take control. Would it say the turn exceeds a what?

    Now, one thing that it doesn't do yet, when you're on the highway and there's like a

    10:56

    corner, it's not going to slow down based on that. That's a feature that's also like in forks.

    So they can do it based on looking at the view and also using satellite data as to like the curves of the road. But you can be on a highway and it can have a pretty aggressive corner and it will still try

    11:12

    to do 100. But that's also a problem in Tesla's autopilot.

    So okay, here we go. Here we go.

    Here we go. Here we go.

    It's got the line. It's got the line, boys.

    Oh, we're over the line. Yeah, this is um not very good so far.

    Yeah. Nope.

    Nope. Turn exceeds steering limit.

    Okay. Okay.

    11:28

    There we go. There we go.

    You know what? That might be a thing with this car.

    The like lane centering cruise control of this car might not have the functionality to turn beyond that. Theoretically, it's detecting this red light, right?

    11:43

    Okay, it stopped on its own. My feet are completely off the pedals.

    My hands are completely off the wheel. Is it going to go?

    No, it's not going to go. Okay, so I tap the accelerator.

    Is it going to go? Oh, yeah.

    She's going. just think is changing.

    Uh yo, it it I mean

    12:00

    uh it changed lanes. It obviously won't signal for you.

    So, it's kind of like driving a BMW. Jesus.

    Let's see how it handles this. Oh, dude.

    It just drove us into a turning lane. I I had to completely intervene there.

    And this light is green and it just

    12:17

    tried to stop me. Okay.

    It doesn't have navigation. There was a navigate feature that they were testing for a bit, but because they're still trying to work on the actual driving model and getting that to be really good, adding that into the training stuff just made everything way

    12:32

    more complicated. And so they removed that for now.

    Let's see if it can stop at the stop sign. Hey, nice.

    Okay, but is it just going to go? Uh, nope.

    This is me. Okay, I'm definitely finding just driving myself a lot less stressful.

    12:49

    What exactly is it that made us choose the Toyota Corolla? If you look on their page of compatibility, you know, it's like 300 cars now, which is great, except not all of them are supported at the same level.

    Some of them don't allow the uh like auto stop start from a stop light or stopping at red lights um at

    13:05

    all, even in experimental mode. Some of them only do the lane centering above a certain speed.

    There's just limitations based on the hardware of the car and how much development has gone into it. Similar reason to why we couldn't just install this into Plof's car.

    Like, there just has to be support for it.

    13:21

    That car has no electric anything. You can't just make an analog hydraulic steering rack turn itself.

    The car has to support the features to begin with. On top of that, we wanted a car that was cheap.

    It wasn't going to work in your Porsche because they don't support it. There's I guess there's not a lot of Porsche dudes that want this in their

    13:38

    car. So, with Linus being a little bit cheap, I wanted to find what is the cheapest self-driving car we could make.

    And this was the cheapest one with the full feature set. Hey, a roundabout.

    Oh god. Let's see what happens in a roundabout, boys.

    I don't think you should have the turn signal on, but it's I mean, it's Yeah.

    13:54

    Okay. No.

    No. No.

    Okay. I got you.

    I got you. I got you.

    I got you, fam. I got you, fam.

    [Laughter] Well, we're real close to that curb, boys. We're like a No.

    No, we weren't. I'm on this side.

    I can see. I disagree.

    14:10

    Uh uh. Let's see what it does.

    Let's see what it does. Oh, no.

    It doesn't know. It doesn't know.

    It doesn't know. It tried to turn.

    No. No.

    It made the right call, dude. It made the right call.

    It just took too long to figure it out. And it couldn't turn that sharply.

    I actually am pretty impressed by how it handled that. I could see how much better this would be if it had navigation data.

    Like live

    14:26

    navigation feed would make this so much more powerful cuz it's not taking into account that the road is going to turn soon. It's just looking at what the cameras can see.

    Okay. Oh, no.

    No. Take control.

    Turning seats, steering wheel. Yeah, that's fine.

    No, no, I got you. I got you.

    I got you. I got you.

    Okay.

    14:41

    This is a merge. Okay.

    So, is this just going to like Oh, she's just going. She was just going to like plow into the back of this Kia.

    It's only lane change assist. Remember, I wouldn't even call that an assist.

    I would call that just sending it.

    14:56

    Dude, this is where it should shine. I just can't believe this is like open source, right?

    We've mentioned it a handful of times. I know, but it even bears mentioning more times cuz that is so cool.

    Just makes me imagine, dude, like this running on like

    15:12

    an M4. Okay.

    No, no, not the car. No, no, I know what you mean.

    But also, yes, that would be cool. What I was going to say, they actually built out support for having an external GPU.

    Really? So, you could run like a huge model on this thing.

    Uh, three.

    15:28

    Literally, why not? You could have more processing power than like a hardware 4 Tesla pretty easily, which I mean, to be honest, that's the other thing I haven't considered up until this point.

    This is like a 5year-old smartphone. Is it more than 5 years?

    More. So you compare the hardware

    15:43

    they're running on to the kind of like neural processing like that's taken off in that last half a decade that we have on modern devices like with an AMD GPU and like they they're using Tiny which is like Geio's company where they're

    15:59

    developing like open AI drivers framework everything right. Oh yeah.

    change. Oh, are you changing lanes?

    Oh, dude, that's so cool. That was awesome.

    It totally warned me. So, imagine if you gave this thing like a 9070 XT in an eGPU dock and just like

    16:15

    stuffed it in your trunk. Dude, she's she's going.

    We have to do that. That has to be part three, man.

    Just put your hands down. You're get I You're such a sketch case.

    Like, just breathe. I haven't intervened at all since we got on the highway.

    I haven't touched the steering wheel at all other than to tell it, hey, I wanted to

    16:31

    change lanes, which is totally fine. I know that it's just like adaptive cruise control and lane keep, but like every car I've ever driven with that sort of stuff, it's just like, man, this is I really really need to pay attention because it does just like derp out randomly.

    And like on the highway, that was I could have had my eyes closed the whole time. Not that

    16:48

    you would or could, but in an alternate universe, yeah, I totally could have. The braking is pretty damn smooth.

    Really good. I didn't even think about it, which is honestly the strongest endorsement that I could give for it.

    Yeah,

    17:03

    the acceleration is a little aggressive sometimes, but the braking is shockingly smooth. Have you touched the steering wheel like at all or the brake?

    No, brother. Wow.

    It's really smooth. Yep.

    I would have believed that that was a human like a like somebody that's trying to be

    17:19

    good. Yes.

    Yeah. That like gives a about their passengers.

    Yeah. Wa, dude.

    It's pretty cool, dude. supposedly because this is like actually like a very state-of-the-art like machine vision AI, whatever you

    17:34

    want to call it, neural network model versus like some of the car ones where it's like just looking for straight white lines or straight yellow lines. It's supposed to be pretty good at handling like nuanced situations where the lines are faded or there's construction lines or you're in a country where there's places that there aren't lines all the time or in

    17:50

    construction or yada yada yada. This is awesome.

    This is pretty cool. Like this is so I if I had a car that supported this, I would buy this right now.

    To be clear, that endorsement is not necessarily because I'm financially irresponsible. Yes, he would buy it to play with it

    18:05

    because it's really cool to play with. But let us at least do the long-term one before we give you guys some kind of solid, hey, we feel this is worth it and also just supporting this project.

    I have a really important question though. Okay.

    In your research for this video, did you check the legality of what we're doing at all?

    18:21

    [Music] It depends. So, Open Pilot says they designed the way that this system works based on the same guidelines that automakers stick to.

    There is also some things to consider depending on where you live. Some jurisdictions don't allow you, technically speaking, to have

    18:38

    anything obstructing the driver's view. You're not supposed to have dash cams.

    You're not supposed to have radar detectors. You're not supposed to have anything on your windscreen.

    That is a consideration. It's not a problem here, but that's something to check.

    Here we go. Here we go.

    She's going. She's going just like that.

    18:53

    And there's like cones. Like there's there's no line on that side.

    That's really cool. It's tracking that line, though.

    Okay. Let's see if I don't This might be too much turn.

    Let's see. Let's see.

    No, I think she can do it. I think she can do it.

    Asking you to take control. Okay.

    All right. All right.

    She almost did it. Okay.

    If I That's interesting.

    19:09

    You probably just need to help it a little bit. Yeah.

    Oh, I didn't actually mention this. It's designed to be like a collaborative thing.

    So, a lot of the self-driving features in other cars are like as soon as you touch the steering wheel, it stops. This is meant to be like you can give it a little bit more and it will it will

    19:25

    work with you. I'd love to see once their hardware gets a little bit more advanced, I'd love to see them integrate that into their training.

    Yeah. Well, I think they do.

    They probably do. Do they?

    Okay. Cuz as an open source project, I'm way more comfortable just like Yeah, sure.

    upload all my

    19:42

    You know what I mean? It totally stopped there, by the Yeah, I totally did.

    That was awesome. That's crazy.

    That was really fun. Yeah.

    Check out the video where we put Android Auto in Plus Scar. That was fun.

    Yeah, that was awesome. That was fun, too.

    I wish we could have put this in Blue's car, but this is also still really