AI Lain

How can I make a Lainbot which functions like a Microsoft clippy but constantly says things like "no matter where you go, everybody is connected" and goes on deranged schizoid ramblings like in the show?

It really depends if the ramblings are generated or not. It also depends if you want to come up randomly or when certain programs are launched. in the case of the latter make it listen to what programs are launched and make it act accordingly (there is probably a libary for that somewhere). If the ramblings are not randomly generated then just make an array and pick from there based on RNG and specific conditions. If it is generated then it becomes much harder

That's a cool idea. I wanna make my desktop experience more random and cyberpunk, it's too boring rn. Any ideas on how to generate those ramblings? I should probably rewatch the show too, don't remember what she was saying.

You can create a locally-hosted chatbot using Pygmalion. There are lots of threads about it on /g/. For example: https://boards.4channel.org/g/thread/91605927 ">Pygmalion-6B model a non-filtered collaboration made by our own Matrixteam, KoboldAI and TavernAI: colab.research.google.com/github/oobabooga/AI-Notebooks/blob/main/Colab-TextGen-GPU.ipynb colab.research.google.com/github/KoboldAI/KoboldAI-client/blob/main/colab/GPU.ipynb >wAIfu Project & Tools github.com/PygmalionAI rentry.org/pygmalion-ai rentry.org/pygmalion-local rentry.org/training-data CAI Dumper: rentry.org/chatlog-dumping CAI Cleaner: dropbox.com/s/spb4c7a2xoedcmh oobabooga.github.io/character-creator.html rentry.org/pygbotprompts rentry.org/PygTips botprompts.net Windows Guide: rentry.org/ipfub >Tavern+Pyg http://youtu.be/asSk_Otl9i4 [Embed] Node.js (Win7): pastebin.com/Ah5ZUcGE TavPyg Cards: booru.plus/+pygmalion Context tokens to ≤1600 >DIY rentry.org/waifu-diy-ai Other: >KoboldAI github.com/henk717/KoboldAI" Potentially, you could even hook it up to stable diffusion so it'd generate images to go along with the chatting, and use a TTS AI to let her talk

At first, you could just make a list/array of strings and make the program randomly choose one. But here are some other pointers: > https://www.sbcl.org + https://www.gnu.org/software/emacs/ + https://github.com/joaotavora/sly + https://elpa.nongnu.org/nongnu/rainbow-delimiters.html (you can find other options at: https://lispcookbook.github.io/cl-cookbook/editor-support.html But do not use Atom because it's dead) > https://gigamonkeys.com/book/ > Read the ELIZA paper: >>>/λ/34195 > https://github.com/norvig/paip-lisp - Also alogs/robowaifu/ probably has some related resources. - Also look up MarkovChains (https://en.wikipedia.org/wiki/Natural_language_generation).

>>67176 as stated in a previous thread, late last year, I was working on a lain ukagaka, which is a little desktop pet that does misc tasks, but is primarily just to sit there and look cute. I plan on redoing the art for it, but I was stuck at deciding what lines of text to put on her

>>67358 Very cute Lain drawing What about taking lines from the show to start with?

>>67364 that's true, I should go ahead and start with that, however if anyone has any specific lines they'd like added to this project, just let me know @ ophanim777 at protonmail.com, I don't want to spam the thread with it.

>>67358 I remember that thread. How is the process going?

>>67358 What do you think about using low performant language model, like pygma-350M for the text? It surely can be sufficient if there no much need for thinking from ukagaka. Like >>67333 that guy said - it can be integrated with stuff like tts and this would be very cool imo

>>67366 I'm restarting the project completely because I have newfound motivation. The process is as simple as drawing sprites and putting in dialogue to be honest. I'm probably going to generate extra text with the lain character.ai model. It's surprisingly a good representation of the character. I talked about ego death with it a while ago.

If you want you could give Lain a voice clone using audio from the show or game. https://beta.elevenlabs.io/

>>67379 We should use the open source alternatives, not proprietary and locked down trash like 11

Is there a database for all of Lain's lines in the show (and game)? You could probably just grab a transcript from the show's subtitles but I'm talking about having the corresponding voice lines organized into accompanying files, too. There's no way some madman hasn't already done this, and it would be intensely useful for this kind of thing, but my cursory search turned up nothing.

>>67390 If it's just some canned lines stored as audio files that's not really necessary. If it's more dynamic speaking then yes absolutely.

>>67397 No luck here either. Scraping from closed captioning would possibly actually work better because it may contain text of who is speaking and the time frame that occurs in which could be used to automatically mark that for getting the audio from that section which should be faster than subtitles or at least that's how it would be for the english dub, i have no idea what Japanese closed captioning looks like or if they even use it or just use subtitles. For the game all the audio and video files are online but im not sure if there is a place it has it organized by character speaking.

>>67397 There are possibly subtitle files for both the game and show, the game had gotten completely reworked to work within your browser, and has been translated into mulitple languages. (laintsx) and subtitle files possibly exist for torrents.

>>67408 I spent some time pursuing this, even though I should definitely be doing something else. To be clear, I looked more for our madman first, but still turned up nothing. The repository for lainTSX (https://github.com/ad044/lainTSX) doesn't seem to contain any of the subtitles for the game, but their website does: https://laingame.net/ Unfortunately, it's PDFs. Probably an easy conversion for someone with more time, though, and they definitely have text files somewhere. Doubly unfortunate, it's only English. Useful if you're doing text generation, but useless if we're considering TTS. (The game's only voiced in Japanese, for the uninitiated.) Is it even possible to get English phonemes from Japanese voice acting? Whatever, I'm just documenting my findings. There does seem to be a Japanese transcript here, though: https://animetranscripts.net/wiki/Serial_Experiments_Lain(Game) I'm too much the novice at moonrunes to read them, though. As for the show, I found some Japanese subtitles via a reddit post (https://www.reddit.com/r/Lain/comments/v71p4f/japanese_subtitles_for_the_serial_experiments/) at this site: https://kitsunekko.net/dirlist.php?dir=subtitles%2Fjapanese%2FSerial+Experiments+Lain%2F (What does Kunagisa mean?) I haven't verified the quality of any of these yet. Also, English subtitles pending. They're probably hanging around. >>67401 Closed captioning is worth looking for. I didn't get to it, regrettably.

>>67358 I've been searching for one, please make it i Beg you

>>67424 Hello, I made the GitHub repository public for anyone interested in messing with it while it is under development. https://github.com/gattsuchan/lain-ukagaka I found scripts for all the episodes and imported notable quotes from the show into the random dialogue file. I am in the process of using the PDFs provided from http://psx.lain.pl/ and importing notable quotes from the game as well. Once I get back to a computer I'm going to fix the issues with the /w4 wait commands for the dialogue. I plan on using the lain character.ai to produce dialogue for more of the dialogue because it feels very much like her character. It's more of how she was at the end of the series, and less of how she was in the game. It's a bit disheartening but it does give her a bit more character.

Look into > https://github.com/gunthercox/ChatterBot

>>67430 This is really cool! First time i hear about these things. Looking forward for it's development :D

>>67423 >Is it even possible to get English phonemes from Japanese voice acting? Yes, same as how some voice cloning programs can use just a small amount of speech recorded which may lack some phenomes but still predict what they may sound like. Only time ive seen this is with the singing AU voice banks in SynthesizerV which produces very convincing sounding English from Japanese voice providers though im not 100% sure if they didnt just record extra phenomes not used in Japanese and used AI to tune it to what it should sound like because it only works with the AI voice banks.

>>67423 Has the Voice actress for Lain ever done any English interviews? If so then maybe that could be an adequate voice bank? I am assuming we are talking the Japanese voice, and not dubbed heresy.

>>67828 Some basic cyber-stalking later, and... no. I found nothing that suggests Kaori Shimizu even knows English. Cool database of her career, though: http://www.usagi.org/doi-bin/seiyuu-lookup.pl?DB=ALL&value=Shimizu+Kaori >>67827 We can hope then, at least. Haven't forgotten this thread, my focus is just easily swayed :)

>>67883 Well shoot. another option, would be to have her speak in japanese, and have a cmd prompt style box pop up with the English text. maybe even allow multiple styles like crt green and crt white? It's not the desired outcome, but sometimes art happens. I know some games are using fully ai voices now, and they have Afrikaner accents. I am wondering if those ai voices are adjustable? Spaceborne 2 is the most recent example that i am aware of. I hope this project succeeds.

Found our madman. Except it's not that easy, of course. It's the developer behind lainTSX. Go figure. https://github.com/ad044/lain-twitter-bot I was searching for contact information to maybe ask for subtitle files and original audio for the game, and I stumbled across it. Not a word of documentation for our posterity, though, the utter... Aside from being bad form and archival malpractice, it means I don't know where the show's subtitles came from. Also, the subtitles for the game appear malformed. Fortunately, I dug through some of the code and found these interesting links: https://laingame.net/index.php?site=0 https://laingame.net/index.php?site=1 Turns out, they're hosting a well-organized directory of every scene from the game, replete with complementary subtitles. The audio quality isn't that great, to be honest, but I think that's just how it originally was. I put together a python scraper that downloads all the things, and it's currently running as I type. However, the subtitles are different from those in the twitter bot repository; they aren't labelled with the character speaking. I assume this is because the repository's subtitles are from documents internal to lainTSX, but they might be available somewhere on this site. So, we're back to square one. Unless one of you wants to start labelling. Don't know how to contact the dev, otherwise. I might try subripping from a no-commentary playthrough of lainTSX (via optical character recognition) -- that was the other idea I had. (Any decent subripping programs out there?) I don't trust the show's subtitles from the repository, either. It's just a twitter bot, after all, perhaps they were unconcerned with the quality. I was thinking of using the English subtitles from the Internet Archive's lain collection (https://archive.org/download/serial-experiments-lain-collection). That, or a fansub. None of this helps with voice synthesizing. Don't know how I'm going to get my grubby hands on Japanese subtitles for the show; we're still missing beyond episode nine. There's probably a kanji/hiragana/katakana to romaji translator if I do, though. Would that help with parsing or is kanji more useful? I don't know. Might start collecting the Japanese scripts of the game from that one website, though I think they aren't complete. I'll take recommendations for an anonymous file hosting service if people want the lainTSX files I'm downloading - not sure if giving out the script would stress their servers. Probably just paranoid. And lastly! I've thought of a name for our TTS- and voice synthesis-related ambitions: "Project LainTalk" Named after PlainTalk, the speech synthesis software used in the title cards for SEL (the "whisper" voice).

>>67969 Ad's contact is primarily through discord, he's a lovely dude. Plays way too much league though. I have messaged him, however the files have to be manually extracted from the psx game as per his instructions listed on https://github.com/ad044/lainTSX. The way you write about him makes him appear much more cryptic than he actually is, it's so funny. Also, there is already a voice synthesizer made for lain from the psx game data. See https://www.youtube.com/watch?v=0StGFjLwyP8

>>67972 >Also, there is already a voice synthesizer made for lain from the psx game data. >already a voice synthesizer >already Well, that's my morning spent.

>>67972 >already a voice synthesizer I'm embarrassed this didn't turn up in my earlier searches. I'll continue work on the dataset, since voicebanks are different in what they can accomplish than AI-derived synthesis. I don't know why I keep saying TTS when I mean text generation, by the way, that's probably confused people. >I have messaged him, however the files have to be manually extracted from the psx game Thank you. It will be useful to confirm where the subtitles came from. I don't think they were extracted from the game, as it was never translated. Although I did just find this repository: https://github.com/laingame-net/lainass >The way you write about him makes him appear much more cryptic than he actually is, it's so funny. Sometimes I forget that behind the cold veneer of a username, programmers are indeed people.

>>67989 Also realize TTS is very different from voice synthesis, I'll be more precise in future.

>>67989 The lainTSX project is a complete recreation of the game for the browser. See https://3d.laingame.net It IS entirely translated into multiple languages, primarily from the English translation provided from http://psx.lain.pl/ from what I remember of the discord server, the Korean translation was also complete. The Spanish translation was close to completion? I don't remember, the Korean translators were the most involved out of everyone translating. There could very well be people translating voice clips even after the server was archived. Also ad said he has the voice clips somewhere, I'll either delete this message and reupload it if he sends me a link or I'll double post, either way.

Ukagaka dev here again. I've found that the PSX game has dialogue that is far more interesting than the TV show. I've been putting together a list of notable dialogue from the files of the game for use in the ukagaka, and a new character.ai model. The current lain model on that website is solely based off of the TV show, so it lacks a lot of dimension. If anyone wants the txt file after it is finished let me know and I can upload it to pastebin.

>>68109 very based, cannot wait

Not worth trying to use a local chatbot unless you have at least 12+ GB of vram, even then a 13B LLM ain't much in terms of intelligence.