/robowaifu/ - DIY Robot Wives

Advancing robotics to a point where anime catgrill meidos in tiny miniskirts are a reality.

Canary has been updated.

Build Back Better

Sorry for the delays in the BBB plan. An update will be issued in the thread soon. -r

Max message length: 6144

Drag files to upload or
click here to select them

Maximum 5 files / Maximum size: 20.00 MB

no cookies?

(used to delete files and postings)

Have a nice day, Anon!

Potential Job Opportunity Robowaifu Technician 07/17/2024 (Wed) 02:41:13 No.32274 [Reply]
Are there any CAD Designers or Mechanical Engineers in this catalog who are seeking employment? I have a legitimate job opportunity for you. You must know Onshape though.
9 posts and 1 image omitted.
>>32308 > I understand that one needs to confidently speak nonsense to navigate the corporate world, it still doesn't inspire much confidence. Covertly speak nonsense to navigate the corporate world anon... We knew this. This is why we are simply providing "robots". Lets just say that no one wants to invest in a waifu based/themed company. However, if the person whose interested in purchasing a robot wants to then make it a "sexbot", then we will fulfill that command. Catch my drift?...

Welcome to /robowaifu/ Anonymous 09/09/2019 (Mon) 00:33:54 No.3 [Reply]
Why Robowaifu? Most of the world's modern women have failed their men and their societies, feminism is rampant, and men around the world have been looking for a solution. History shows there are cultural and political solutions to this problem, but we believe that technology is the best way forward at present – specifically the technology of robotics. We are technologists, dreamers, hobbyists, geeks and robots looking forward to a day when any man can build the ideal companion he desires in his own home. However, not content to wait for the future; we are bringing that day forward. We are creating an active hobbyist scene of builders, programmers, artists, designers, and writers using the technology of today, not tomorrow. Join us! NOTES & FRIENDS > Notes: -This is generally a SFW board, given our engineering focus primarily. On-topic NSFW content is OK, but please spoiler it. -Our bunker is located at: https://trashchan.xyz/robowaifu/catalog.html Please make note of it. -Library thread (good for locating terms/topics) (>>7143) > Friends: -/clang/ - currently at https://8kun.top/clang/ - toaster-love NSFW. Metal clanging noises in the night. -/monster/ - currently at https://smuglo.li/monster/ - bizarre NSFW. Respect the robot. -/tech/ - currently at >>>/tech/ - installing Gentoo Anon? They'll fix you up. -/britfeel/ - currently at https://trashchan.xyz/britfeel/ - some good lads. Go share a pint! -/server/ - currently at https://trashchan.xyz/server/ - multi-board board. Eclectic thing of beauty. -/f/ - currently at https://trashchan.xyz/f/res/4.html#4 - doing flashtech old-school. -/kind/ - currently at https://wapchan.org/kind - be excellent to each other.

Message too long. Click here to view full text.

Edited last time by Chobitsu on 04/03/2024 (Wed) 03:57:55.

Open file (104.93 KB 592x565 IMG_20200725_160316.png)
Emmy the Robot Robowaifu Technician 07/14/2024 (Sun) 17:57:53 No.32205 [Reply] [Last]
Welcome all Nandroids fans to the Emmy thread, for discussing and posting about EtR. Off-topic posts and personal attacks will be deleted. --- Also, be sure to check out Emmy-Pilled's project thread! (>>25306) Important Community Links: Boorus, etc.: https://nandroid.booru.org/index.php Google Docs: https://docs.google.com/spreadsheets/d/1mXuNh9ESedCiDZclVuz9uiL7nTNk3U9SgCE_CRHi3Us/htmlview# Webtoons: https://m.webtoons.com/en/canvas/emmy-the-robot/list?title_no=402201 > previous threads : >>27481 >>26629 >>30919
76 posts and 50 images omitted.
>>32353 that sounds cool
>>32353 Millie the robot, RustyHorns
>>32359 why he use wendy....... give real wendy.................

C++ General Robowaifu Technician 09/09/2019 (Mon) 02:49:55 No.12 [Reply] [Last]
C++ Resources general The C++ programming language is currently the primary AI-engine language in use. isocpp.org/get-started https://archive.is/hp4JR stackoverflow.com/questions/388242/the-definitive-c-book-guide-and-list https://archive.is/OHw9L en.cppreference.com/w/ https://archive.is/gt73H www.youtube.com/user/CppCon https://archive.is/QGynC BTW if you're new to C++ and you're stuck on Windows (either you can't or won't upgrade to Linux) then you can at least incorporate a good, open shell into your system to begin with so you can follow along. Start at this link, and if you have any questions just ask ITT:

Message too long. Click here to view full text.

Edited last time by Chobitsu on 04/04/2024 (Thu) 23:25:55.
272 posts and 78 images omitted.
>>32343 What I did was take this lesson #include <stdio.h> int main() { char chr; printf("Enter a character: "); scanf("%c",&chr); printf("You entered %c.", chr); return 0; } Then I realized this seems similar to a messaging system so I tried to see what happens. I was able to replace it for integers and that ran so then I tried to see if I could make it give me all the characters I type in a sentence. #include <stdio.h> int main() { char chr; printf("Enter a message: ");

Message too long. Click here to view full text.

>>32351 Here's a couple of operator>> examples : >char_str_inputs.cpp #include <iostream> #include <string> using namespace std; int main() { char foo{' '}; string bar; // as with operator<< , these types each already have operator>> defined cin >> foo; // example input: 'Z' cin >> bar; // example input: "Robowaifus"

Message too long. Click here to view full text.

>>32352 I was focusing on C first since C++ is technically an extension of C so I wanted to see the barrier. That code must be C++ because it wouldnt run as C but did for C++ but I put in "test words" and it gave me "you input 't' and 'est' " which is different from what I was going for though interesting to see if I put multiple words separated by a space it behaves that way different from one word and enter then another and enter. Tried seeing if changing it to string bar and removing all foo references which still only output a single word. Then when I look up how to do it, it's totally different setup for a getline...bleh #include <iostream> #include <string> using namespace std; int main() { string usr_str; getline(cin, usr_str); cout << "You input: " << usr_str << endl; return 0; }
>>32354 Good job, Anon! Way to do research on your own. Yes, you've found the way to do regularized input for a char (your first 't'), string, and whitespace-separated string collections. As your example shows, it's both simple to do, and pretty much bulletproof from unintentional crashing (since the resources are properly managed through the type's handle (ie, std::string).
>>32354 >>32355 Also, filestreams (in or out) work the same as textstreams do. >fortune_cookie.cpp #include <fstream> #include <iostream> #include <string> using namespace std; // given: a multi-line textfile named 'fortunes.txt' in the project path, containing : /* you will be singled out for promotion good ideas will spring forth naturally from your mind in the coming week good health will be yours for a long time you will be spending time outdoors in the mountains near water you will soon take a very pleasant and successful trip

Message too long. Click here to view full text.

Edited last time by Chobitsu on 07/24/2024 (Wed) 17:51:46.

SPUD (Specially Programmed UwU Droid) Mechnomancer 11/10/2023 (Fri) 23:18:11 No.26306 [Reply] [Last]
Henlo anons, Stumbled here via youtube rabbit hole & thought I'd share my little side project. Started out as just an elaborate way to do some mech R&D (making a system to generate animation files on windows blender and export/transfer them to a raspberry pi system) and found tinkering with the various python libraries a kinda neat way to pass the time when whether doesn't permit my outside mech work. Plus I'd end up with a booth babe that I don't have to pay or worry about running off with a convention attendee. Currently running voice commands via google speech and chatgpt integration but I'm looking into offline/local stuff like openchat. WEF and such are so desperate to make a totalitarian cyberpunk dystopia I might as well make the fun bits to go along with it. And yes. Chicks do dig giant robots.
378 posts and 215 images omitted.
>>32164 Lol. Big Girl.
Open file (1.22 MB 1168x1672 ROBOWAIFU BANE.png)
>>32164 >>32170 "You think the owo is your ally? But I was born into it, shaped by it..."
>>32170 UUUU
>>32172 >>32180 >The kawaii catgrils betray you, because they belong to me. I will show you where I have made my robowaifu home, whilst preparing to bring moe justice. Then, I will UWU you.
Open file (147.17 KB 453x989 standing.jpg)
SPUD is currently standing unpowered in the garage workshop. Been working on other, more critical projects.

Open file (349.32 KB 480x640 0c.png)
Robowaifu Media Propaganda and Merchandizing Anon 01/29/2023 (Sun) 22:15:50 No.19295 [Reply] [Last]
That Time I Incarnated My Christian Cat Girl Maid Wife in a Short Dress Together we can create the robowaifu-verse! Let's start making media to further our cause. There's tremendous potential for us to reach a wide market and prime minds to accept their future cat grill meidos in tiny miniskirts. We have text based stories floating around but, audio and visuals are paramount to gain a general audience. I will start with a short about a young man building a small cat girl and learning to understand her love. Importantly, she will be very limited, in the same way our first models will be. To set certain expectations. Mahoro is impossible but, the slow and simple robowaifus that can exist have their own charm. Let's show the world the love that will soon exist. --- >thread-related Robowaifu Propaganda and Recruitment (>>2705) >=== -add related crosslink
Edited last time by Chobitsu on 02/02/2023 (Thu) 22:18:06.
63 posts and 34 images omitted.
>>32237 Okay, where's the vocaloid from? >>32238 Yeah, sounds quite nice. Partially a bit hard to understand, but that happens often.
>>32247 I meant I had "japanese female vocaloid" in the song style, but the generated rythm often didn't fit.
>>32252 Ah, okay. I realized that this doesn't work. If you use Japanese it will have problems with the voice. Trying to pronounce the English in Japanese and maybe also have worse audio quality. Anyways, your lyrics are good. Do you have an account and and identifier there? >Hedra.com They started to take money for their website. Free generation of some videos is still possible, but more limited. Until a few days ago, it was possible to use it for free and generate without limits, but it had a longer and longer waiting times. >Live Portrait AI This might become a alternative to Hedra, but also going beyond it, more towards acting. https://www.youtube.com/watch?v=uyjSTAOY7yI https://www.youtube.com/watch?v=8-IcDDmiUMM https://www.youtube.com/watch?v=i39xeYPBAAM There was also another one, from China, but they only showed it of without releasing the model or anything.
>>32257 Some examples of AI generated short movies, to show what is possible right now: Unanswered Oddities (three episodes so far): https://youtu.be/YGyvLlPad8Q https://youtu.be/haBNiAridLI https://youtu.be/0XvmCrrnaHA For most things it can't be used in a reasonable way right now. There are some very short movies like "Dead Sea" which are more like clips, in this case a pirate movie short (I thought it was rather boring). There are also some others, but so far characters can mostly stand around, scenes and characters are changing sometimes, and the landscapes are also inconsistent. Only relatively static scenes work, which is why the concept above it one of the best working ones. Trippy horror might also be okay (not suitable for everyone): https://youtu.be/GO5diAgu1vA (cyborgs) https://youtu.be/W9dng6ZZ9-k (aliens with women issues, hehe) This is also similar to what I thought a while ago: Use stories, new or old and maybe out of copyright now (Lovecraft), self-written or generated, make it into an audio book, ideally with a good human reader. Then make some AI generated pictures or maybe animated clips, and combine that into a video. Some scenes could also be with characters talking parts of the dialog, but this is of course more effort. The difference is, what I meant would be less like a movie and much longer. More like Horrorbabble, but with pictures and some clips. The clips often just in a loop.
>>32238 >Synthwife Thanks for adding the lyrics.

Open file (1.45 MB 1650x1640 gynoid_anime.jpg)
Robowaifus in Media: Thread 02 Robowaifus in Media: Thread 02 01/14/2023 (Sat) 23:49:54 No.18711 [Reply] [Last]
Post about whatever media predominately features at least one fembot aka gynoid (female form of an android) as an important character, ideally a robowaifu or synthetic girlfriend. Some freedom with the topic is allowed, virtual waifus or bodiless AI might also qualify if she is female. Negative framing of the whole topic should be mentioned with negative sentiment. Cyborgs with a human brain or uploads of women don't really fit in, but if she's very nice (Alita) and maybe not a human based cyborg (catborg/netoborg) we can let it slide. Magical dolls have also been included in the past, especially when the guy had to hand-made them. Look through the old thread, it's worth it: >>82 - Picrel shows some of the more well know shows from a few years ago. I made a long list with links to more info's on most known anime shows about fembots/robowaifus, without hentai but including some ecchi and posted it here in the old thread: >>7008 - It also features some live-action shows and movies. I repost the updated list here, not claiming that it is complete, especially when it comes to live action and shows/movies we don't really like. >In some cases I can only assume that the show includes robogirls, since the show is about various robots, but I haven't seen it yet. A.D. Police Files: https://www.anime-planet.com/anime/ad-police-files Andromeda Stories: https://www.anime-planet.com/anime/andromeda-stories Angelic Layer: https://www.anime-planet.com/anime/angelic-layer Armitage III: https://www.anime-planet.com/anime/armitage-iii Azusa will help: https://www.anime-planet.com/anime/azusa-will-help Blade Runner 2022: https://www.anime-planet.com/anime/blade-runner-black-out-2022 Busou Shinki: https://www.anime-planet.com/anime/busou-shinki-moon-angel Butobi CPU: https://www.anime-planet.com/anime/buttobi-cpu Casshern Sins: https://www.anime-planet.com/anime/casshern-sins Chobits: https://www.anime-planet.com/anime/chobits

Message too long. Click here to view full text.

Edited last time by Chobitsu on 10/14/2023 (Sat) 05:44:28.
261 posts and 176 images omitted.
>>32329 Yeah, I found this one delightful. It seemed the most 'robowaify' of the four so far. When the MC dived into 'save' Super Mina, it gave me the vibe of Hideki doing similar in Chobits. >>32330 Based.
Open file (219.53 KB 1920x1080 SmugGremlin.jpg)
Open file (161.14 KB 1280x720 Consent.jpg)
Open file (134.12 KB 1280x720 PostClang.jpg)
Open file (433.27 KB 1280x720 Loving.png)
ATRI Episode 2 I am almost certain the original creator just wanted to clang a mesugaki. Everything in the world feels like it exists for a soulful romance between a the authors poorly disguised self insert and a tiny brat. Literary devices to justify an authors vices. It was daring of them to have actually insinuated actual clanging happened, that she enthusiastically consented to it, and thoroughly enjoyed it. Of course, this all subtext and she could just be teasing him. At the very least, he did pull her into bed with him, took off her dress as she wakes up in her underwear, and cuddled with her. His tsundere antics and consistent abuse of her when not using her for comfort in bed felt over the top. Her being a super advanced robot that struggles to do anything would have been annoying if I didn't understand how realistic it is. Robots will struggle in real life without clear guardrails and guidelines. She clearly shows signs of being trained to work in a different environment, and her AI struggles to fill in the blanks. A small detail which really adds to her character feeling like a robot. It's cute and funny.
Open file (515.30 KB 2560x1440 RunningUnderWater.jpg)
>>32331 Her running under water was also hilarious. It was nice to see the MC step up and be a good man when he was clearly confused by most of the situation.
For the manga of My Wife Has No Emotion, there's a pretty strong return to the wholesome family antics we started with. Mina starts developing more emotions (even though she still can't show them), mamoru gets a new body, Erisu stops being a deliquent and starts training for motherhood, and Takuma's sister just keeps getting more based every time she shows up. If any of you dropped this because of the domestic terrorism arc or the ayy lmao arcs, this is the time to pick it back up.
Thanks for the updates. >>32332 >ATRI Glad that it seems to work out well. >>32334 >MWHNO > pretty strong return to the wholesome family antics Good news indeed. I was hoping the manga would be good, just in case the anime wants to follow it

Open file (58.56 KB 1244x2374 MaidComFront.jpg)
Open file (39.04 KB 1244x2318 MaidComSide.jpg)
Open file (56.65 KB 1244x2318 MaidComBack.jpg)
MaidCom Kiwi 02/08/2024 (Thu) 06:40:01 No.29219 [Reply] [Last]
MaidCom Project Thread 2 Project Goal: Simple, low cost, extensible platform for robowaifu development. Picrel shows the model which is being developed. Every part will be designed to be easily printable and replaceable. Her designs will be open source. Modding and customization will be encouraged. This is a base model. Early revisions will be heavily limited in functionality. I invite you to help design and define standards so that it is easy to create specialized add-ons to allow her to become your own waifu. Collaboration is important, MaidCom is officially partnered with Lin and his Waifu Wheelchair, if you'd also like to be officially partnered, say so. Cat eats and miniskirts are encouraged!
53 posts and 44 images omitted.
>>31824 Interesting update. Thanks.
>>31824 Oh neat! You've really captured the form of Aigis' face quite well there, Kiwi. GG. It'll be interesting to see how you manage the eyes. Keep up the good work, Anon!! >whipple tree mechanisms Very cool. Yes, if we can greatly-reduce the typical complexity of common 'bionic' hands and yet still retain good grasping dexterity that would be a big step forward in reducing complexity/cost. >print-in-place THIS! I hope this can be solved. Cheers, Kiwi. :^)
Open file (200.72 KB 561x903 NeoTorso.png)
Open file (116.29 KB 594x709 NeoThigh.png)
>>31928 Still working on her hand. Took a detour to revamp her torso to have more defined navel and clavicles. Refined her thigh to have more hunan curves and added a knee. Going to take a break from updating her body to focus on actuator development. I want to integrate her motive system now.
>>32320 >revamp her torso to have more defined navel and clavicles. Refined her thigh I think that looks better. Good work.
>>32320 Great, looks nice.

Open file (46.39 KB 458x620 eve preview.jpg)
My Advanced Realistic Humanoid Robot Project - Eve Artbyrobot 04/18/2024 (Thu) 17:44:09 No.30954 [Reply] [Last]
So far I have plans to build Adam, Eve, and Abel robots. All of these are Bible characters. This thread will cover the Eve robot. Eve will have no "love holes" because adding those would be sinful and evil. It is a robot, not a biological woman after all and I will view her with all purity of heart and mind instead of using her to fulfill my lusts of my body. Instead I will walk by the Spirit no longer fulfilling the lusts of the flesh as the Bible commands. Eve will be beautiful because making her beautiful is not a sinful thing to do. However, I will dress her modestly as God commands of all women everywhere. This would obviously include robot women because otherwise the robot woman would be a stumbling block to men which could cause them to lust after her which would be a sin. To tempt someone to sin is not loving and is evil and so my robot will not do this. To dress her in a miniskirt, for example, would be sinful and evil and all people who engage in sinfullness knowingly are presently on their way to hell. I don't wish this for anyone. My robot will dress in a way that is a good example to all women and is aimed toward not causing anybody to lust as a goal. My robot will have a human bone structure. It will use either a PVC medical skeleton or fiberglass fabricated hollow bones. My robot will look realistic and move realistic. It will be able to talk, walk, run, do chores, play sports, dance, rock climb, and do gymnastics. It will also be able to build more robots just like itself and manufacture other products and inventions. I realized with just a head and arm, a robot can build the rest of its own body so that is my intention. My robot will use BLDC motors for drones, RC, and scooters that are high speed and low-ish torque but I will downgear those motors with a archimedes pulley system that will be custom made from custom fabricated pulleys that will be bearings based. By downgearing with pulleys, instead of gears, I will cut down the noise the robot makes so it will be as silent as possible for indoor use. By downgearing, I convert the high speed motors into moderate speeds with great torque. BLDC motors with large torque generally are too large in diameter for a human form factor and take up too much volumetric area to be useful which is why I go with the high speed smaller diameter type motors but just heavily downgear them 32:1 and 64:1. My robot will have realistic silicone skin. Thom Floutz -LA based painter, sculptor, make-up artist is my inspiration as it pertains to realistic skin. The skin for my robots has to be at his level to be acceptable. It must be nearly impossible to tell the robot is not human to be acceptable. I will have a wireframe mesh exoskeleton that simulates the volumes and movements of muscle underneath the skin which will give the skin its volumetric form like muscles do. Within these hollow wireframe mesh frameworks will be all the electronics and their cooling systems. All of my motor controllers will be custom made since I need them VERY small to fit into the confined spaces I have to work with. I need LOADS of motors to replace every pertinent muscle of the human body in such a way that the robot can move in all the ways humans move and have near human level of strength and speed.

Message too long. Click here to view full text.

74 posts and 43 images omitted.
Open file (5.45 KB 383x242 R.gif)
>>32048 I've been thinking about an energy-saving method, besides the power supply and propulsion system recently. With the way my desktop is working out, I was thinking of putting breaks in the joints. A power-on break uses power when the break is enabled, while a power-off break only uses power to disable the breaks. I was leaning towards the latter for a while, because it would mean more power is used while moving, but standing upright could be done indefinitely without using energy. I've been trying to come up with a magnetic flux-switching design for a break that would only use power when switching between off and on. A power-toggle break.
Open file (49.48 KB 378x710 SwitchedFlux.jpg)
>>32321 You may find switched flux motors to be interesting. https://www.sciencedirect.com/science/article/pii/S2090447922001022
>>32321 >>32322 I agree both are interesting. Something to look at and "ponder". Look at this video and see if you can tell what is going on. This appears to be a magnetic superconductor (B-field???) Leedskalnin_Effect_Demo https://www.youtube.com/watch?v=eWSAcMoxITw Why there's not a ton of speculation and people studying this non-stop, I have no idea. It's my understanding that a circuit like this can stay together indefinitely. Also if you keep the wire in and separate the plates the energy in will come out in a circuit connected to the wire. Not sure if it's the same amount but it is substantial. I think this is one of those things where scientist say,"well that's just so and so doing this and that(feeding you equations)..." while totally missing the point that this is a fairly huge abnormality and quite odd.
>>32323 That's just storing energy in a magnetic field. When you break the circuit, the field will reverse. This will cause the metal to de-magnetise and if a coil is there, some percent of the initial energy will be inducted. It's essentially the magnetic flux version of a capacitor. Transformers and inducters work on similar principles. You may also find electropermanent magnets interesting, same thing but with a permanent magnet to essentially create a switchable permenate magnet that won't induce as strong of a counter flux if the magnetic circuit is broken. https://en.m.wikipedia.org/wiki/Electropermanent_magnet
>>32324 >That's just storing energy in a magnetic field In my opinion this is much more interesting and strange than the standard reasoning you have just given. What you said is of course the correct opinion. The magnetic field is confined to the metal. It does not extend like a coil. To the best of my knowledge it does not attenuate over time or at the least any appreciable short time. Here's an article that explores this sort of weirdness RIGHT ANGLE CIRCUITRY - or - AC Electronics for Alien Minds (C)2000 William Beaty http://amasci.com/elect/mcoils.html Beaty has some super interesting articles.

Open file (329.39 KB 850x1148 Karasuba.jpg)
Open file (423.49 KB 796x706 YT_AI_news_01.png)
Open file (376.75 KB 804x702 YT_AI_news_02.png)
General Robotics/A.I./Software News, Commentary, + /pol/ Funposting Zone #4 NoidoDev ##eCt7e4 07/19/2023 (Wed) 23:21:28 No.24081 [Reply] [Last]
Anything in general related to the Robotics or A.I. industries, and any social or economic issues surrounding it (especially of robowaifus). -previous threads: > #1 (>>404) > #2 (>>16732) > #3 (>>21140)
430 posts and 173 images omitted.
>>32173 Indeed the same idea can be extended even to environments that don't have multiple independent episodes, basically where the agent only experiences one very long "episode". However, this requires two additions. First, you need a discount factor g, a number between 0 and 1, strictly less than 1. This is used to make the agent prioritize near term rewards more than long term rewards, for example a reward that is 100 actions away is discounted by a factor of g^100. You cannot handle the "one very long episode" case without some kind of time horizon, and the discount factor effective creates a kind of soft time horizon. Second, you have to bootstrap off a learnable value function estimate. The value function equals the expected value of the total reward the agent gets when starting from a state and using its policy until the end of the episode. When there is only "one very long episode", this needs to be the infinite sum for all future actions, which is still a finite number thanks to the discount factor g. You can then cut the "one very long episode" into spans of arbitrary length. For each span, you assume the total reward after the cut will equal the value function estimate, and you can still train the agent with policy gradient. At first, the value function estimate will be randomly initialized and is totally inaccurate, you simultaneously need to train it to more closely resemble the true value function. This training is also done with the cut up spans, you again apply the value function estimate for the end of the span, and bootstrap off it to compute more accurate (but still biased) estimates of the value function for the other steps in the span. With a discount factor g strictly less than 1, the training eventually makes the estimate converge to the true value. And when the value function is estimated accurately, the policy converges to the optimal actions.
>>32195 That is amazingly-interesting, Anon. It's also very encouraging to know that this approach can serve in a less-preplanned, more-adhoc environment. Any estimate about the hardware compute costs involved? POTD
>>32197 Yeah, this would be an example of a model-free RL algorithm. It only needs to know what state the agent is in, which action is taken, and what the reward for the action is. My impression is that for RL used in robotics, the dominant cost is the simulation of the environment (or worse, the data collection from running the agent in the real world), not the calculations or updates from the loss function. Running these simulations can be pretty similar to running high graphics quality 3D games. For RLHF with LLM's you have a reward model that's a neural net, so you need big enough GPUs to fit the models. But regardless, you want an algorithm that converges in as few steps as possible. With model-free RL, the training speed is mostly limited by how quickly you can gain information about the environment. You want a policy that explores interesting actions more often than uninteresting actions during training. You cannot optimize prematurely based on too little information, or the policy will be stuck in a local optimum. This is also why LLMs need supervised fine-tuning before RLHF, or why some RL experiments add some kind of curiosity into the agent. If you have control over the reward definition, you also want to shape the reward so that partial progress is rewarded too, even if the agent fails to achieve the final goal. You can see Nvidia's Eureka paper, they used LLM's to write reward functions to do this.
>>32201 Great! That's about what I expected regarding costs. We still need to try finding a solution for Robowaifu@home for training needs, heh. I've grabbed the paper and I'll make time to go over it soon. Thanks, Anon! Cheers. :^)
>>32201 >You want a policy that explores interesting actions more often than uninteresting actions during training. You cannot optimize prematurely based on too little information, or the policy will be stuck in a local optimum. I've mentioned before in other threads that the AI I'm looking to make will have "needs" to motivate her actions. Most will be essential things like changing the battery, but otherwise her needs are to cater to my needs. One of the needs is "boredom" which will punish her for being idle for too long or too much repetition. It might be worth it to do things in a less than optimal way if it means potentially discovering a more efficient way of doing something.

Report/Delete/Moderation Forms