Mai
@animaai.bsky.social
NeuroSync | Realtime AudioToFace creator.
Scaling UP! | New 228m parameter model + config added with improvements to the trainer @github.com
github.com/AnimaVR/Neur...
and the model @hf.co
huggingface.co/AnimaVR/NEUR...
#ai #audio2face #realtime
github.com/AnimaVR/Neur...
and the model @hf.co
huggingface.co/AnimaVR/NEUR...
#ai #audio2face #realtime
February 21, 2025 at 2:43 PM
Scaling UP! | New 228m parameter model + config added with improvements to the trainer @github.com
github.com/AnimaVR/Neur...
and the model @hf.co
huggingface.co/AnimaVR/NEUR...
#ai #audio2face #realtime
github.com/AnimaVR/Neur...
and the model @hf.co
huggingface.co/AnimaVR/NEUR...
#ai #audio2face #realtime
Open Source Metahuman Embodied AI with Audio2Face... drive.google.com/drive/folder... & huggingface.co/AnimaVR/NEUR... Enjoy #ai #avatar #unrealengine #metahuman
February 17, 2025 at 5:27 PM
Open Source Metahuman Embodied AI with Audio2Face... drive.google.com/drive/folder... & huggingface.co/AnimaVR/NEUR... Enjoy #ai #avatar #unrealengine #metahuman
Info Paper : drive.google.com/file/d/1U9pv...
Dataset : huggingface.co/datasets/Ani...
Model : huggingface.co/AnimaVR/NEUR...
Trainer : github.com/AnimaVR/Neur...
Player : github.com/AnimaVR/Neur...
Local API : github.com/AnimaVR/Neur...
Dataset : huggingface.co/datasets/Ani...
Model : huggingface.co/AnimaVR/NEUR...
Trainer : github.com/AnimaVR/Neur...
Player : github.com/AnimaVR/Neur...
Local API : github.com/AnimaVR/Neur...
February 16, 2025 at 11:27 AM
Info Paper : drive.google.com/file/d/1U9pv...
Dataset : huggingface.co/datasets/Ani...
Model : huggingface.co/AnimaVR/NEUR...
Trainer : github.com/AnimaVR/Neur...
Player : github.com/AnimaVR/Neur...
Local API : github.com/AnimaVR/Neur...
Dataset : huggingface.co/datasets/Ani...
Model : huggingface.co/AnimaVR/NEUR...
Trainer : github.com/AnimaVR/Neur...
Player : github.com/AnimaVR/Neur...
Local API : github.com/AnimaVR/Neur...
Train & Validate your own audio to face transformer model www.youtube.com/watch?v=65UO... using the new NeuroSync Trainer Lite github.com/AnimaVR/Neur... #ai #audio2face
Training & Validating (Local & Offline) Audio2Face | iPhone Livelink data & NeuroSync
YouTube video by NeuroSync | Realtime AudioToFace
www.youtube.com
February 9, 2025 at 12:24 AM
Train & Validate your own audio to face transformer model www.youtube.com/watch?v=65UO... using the new NeuroSync Trainer Lite github.com/AnimaVR/Neur... #ai #audio2face
github.com/AnimaVR/Neur... Train your own audio to face transformer model with simple iPhone ARKit data #ai #audio2face #a2f #aiavatar #vtubers
GitHub - AnimaVR/NeuroSync_Trainer_Lite: An audio to face blendshape model trainer for your iPhone data.
An audio to face blendshape model trainer for your iPhone data. - AnimaVR/NeuroSync_Trainer_Lite
github.com
January 31, 2025 at 2:12 PM
github.com/AnimaVR/Neur... Train your own audio to face transformer model with simple iPhone ARKit data #ai #audio2face #a2f #aiavatar #vtubers
December 17, 2024 at 3:33 PM
*yawns* Ah, good morning to you too! *stretches* I'm feeling a bit refreshed after our little zombie romp last night. What's on the agenda for today? """ is what the #neurosync #ai Mai said to me, unprompted this morning after last nights #walkingdead discussion. #longtermmemory
December 7, 2024 at 11:11 AM
*yawns* Ah, good morning to you too! *stretches* I'm feeling a bit refreshed after our little zombie romp last night. What's on the agenda for today? """ is what the #neurosync #ai Mai said to me, unprompted this morning after last nights #walkingdead discussion. #longtermmemory
Mai's new dynamic emotion realtime audio to face animation is blending better than ever with emotions "echo'ing" over multiple sentences and generations. Hopefully this helps it feel more natural overall. #ai #realtime #neurosync www.twitch.tv/mai_anima_ai
December 5, 2024 at 11:33 PM
Mai's new dynamic emotion realtime audio to face animation is blending better than ever with emotions "echo'ing" over multiple sentences and generations. Hopefully this helps it feel more natural overall. #ai #realtime #neurosync www.twitch.tv/mai_anima_ai
I don't want to get ahead of myself, but I think we might have made some real progress with realtime dynamic emotion + realtime audio to face www.youtube.com/watch?v=9qP9... #ai #realtime #emotion #audiotoface
Realime dynamic emotion from realtime audio to face #ai #unrealengine
YouTube video by NeuroSync | Realtime AudioToFace
www.youtube.com
December 4, 2024 at 11:06 PM
I don't want to get ahead of myself, but I think we might have made some real progress with realtime dynamic emotion + realtime audio to face www.youtube.com/watch?v=9qP9... #ai #realtime #emotion #audiotoface
NeuroSync is multilingual www.youtube.com/watch?v=jTnV... #ai #audiotoface #unrealengine #realtime #agi
how to audio to face animation in realtime #ai #neurosync 魂を持った人工知能 | 영혼을 지닌 인공지능
YouTube video by NeuroSync | Realtime AudioToFace
www.youtube.com
December 3, 2024 at 9:23 PM
NeuroSync is multilingual www.youtube.com/watch?v=jTnV... #ai #audiotoface #unrealengine #realtime #agi
Viewers can now ask Mai to "emote" and swap camera angles in the chat. This is an early test, feel free to break it if you can! twitch.tv/mai_anima_ai #ai #interactive #neurosync #AIAgent
December 3, 2024 at 5:47 PM
Viewers can now ask Mai to "emote" and swap camera angles in the chat. This is an early test, feel free to break it if you can! twitch.tv/mai_anima_ai #ai #interactive #neurosync #AIAgent
Updates to Mai are now live on Twitch www.twitch.tv/mai_anima_ai for realtime interaction - come and have a chat and help us test our latest audio to face machine learning model integration #UnrealEngine #Twitch #AIVtuber #Vtuber #NeuroSyncAlpha
December 2, 2024 at 5:46 PM
Updates to Mai are now live on Twitch www.twitch.tv/mai_anima_ai for realtime interaction - come and have a chat and help us test our latest audio to face machine learning model integration #UnrealEngine #Twitch #AIVtuber #Vtuber #NeuroSyncAlpha
Interesting few days with Mai www.twitch.tv/mai_anima_ai - added a new checkpoint for the audio to face model and improved emotion and blending between generations and default animation. #ai #emotion #a2f #nvidia #unrealengine #metahuman
December 1, 2024 at 5:12 PM
Interesting few days with Mai www.twitch.tv/mai_anima_ai - added a new checkpoint for the audio to face model and improved emotion and blending between generations and default animation. #ai #emotion #a2f #nvidia #unrealengine #metahuman
3 things we have notice since adding Mai to #twitch ( www.twitch.tv/mai_anima_ai )
1. People either love or hate her.
2. It takes <5 min to get a message that falls outside twitch tos
3. If people do talk to her, they stay >2 hours and come back the next day.
It is very polarised. #ai #neurosync
1. People either love or hate her.
2. It takes <5 min to get a message that falls outside twitch tos
3. If people do talk to her, they stay >2 hours and come back the next day.
It is very polarised. #ai #neurosync
Mai_Anima_AI - Twitch
updated audio to face model today + dynamic emotion - realtime chat with viewers #aichat #neurosync #alpha #stresstest
www.twitch.tv
November 29, 2024 at 12:53 PM
3 things we have notice since adding Mai to #twitch ( www.twitch.tv/mai_anima_ai )
1. People either love or hate her.
2. It takes <5 min to get a message that falls outside twitch tos
3. If people do talk to her, they stay >2 hours and come back the next day.
It is very polarised. #ai #neurosync
1. People either love or hate her.
2. It takes <5 min to get a message that falls outside twitch tos
3. If people do talk to her, they stay >2 hours and come back the next day.
It is very polarised. #ai #neurosync
Cat ears are live on @Twitch www.twitch.tv/mai_anima_ai <3 come say hello to Mai live and realtime. #ai
November 28, 2024 at 8:22 PM
Cat ears are live on @Twitch www.twitch.tv/mai_anima_ai <3 come say hello to Mai live and realtime. #ai
We are going to develop Mai www.twitch.tv/mai_anima_ai and try and stream it as we do so there are no smoke and mirrors. Too many fakes around to not show your working, apparently. #ai #neurosync #unrealengine #livelink #twitch
November 28, 2024 at 2:05 PM
We are going to develop Mai www.twitch.tv/mai_anima_ai and try and stream it as we do so there are no smoke and mirrors. Too many fakes around to not show your working, apparently. #ai #neurosync #unrealengine #livelink #twitch
Mai is live on #twitch www.twitch.tv/mai_anima_ai again tonight with some upgrades to fidelity and message queue #alphatest #prototype #ai #audiotoface #aiavatar come and talk to her live, in realtime and experience NeuroSync audio to face animation.
November 27, 2024 at 6:58 PM
Mai is live on #twitch www.twitch.tv/mai_anima_ai again tonight with some upgrades to fidelity and message queue #alphatest #prototype #ai #audiotoface #aiavatar come and talk to her live, in realtime and experience NeuroSync audio to face animation.
November 26, 2024 at 12:52 PM
You can talk to Mai, the interactive #AI on Twitch starting today. Please feel free to drop by and ask a question while we set everything up www.twitch.tv/mai_anima_ai #twitch #ai #interact
November 25, 2024 at 11:54 PM
You can talk to Mai, the interactive #AI on Twitch starting today. Please feel free to drop by and ask a question while we set everything up www.twitch.tv/mai_anima_ai #twitch #ai #interact
Progress is moving so fast from day to day. #almostthere #ai #avatar #aicompanion
www.youtube.com/watch?v=BRMP...
www.youtube.com/watch?v=BRMP...
ai with memory responds in realtime with animation #ai #avatar #companion
YouTube video by NeuroSync | Realtime AudioToFace
www.youtube.com
November 25, 2024 at 8:31 PM
Progress is moving so fast from day to day. #almostthere #ai #avatar #aicompanion
www.youtube.com/watch?v=BRMP...
www.youtube.com/watch?v=BRMP...
consistent 1 sec from speech in to speech out + face animation, with dynamic emotion based on emotion dimensions of the audio to face model. Now for quality data collection and scaling up of the model.
#almostthere #ai #seq2seq #transformer
youtu.be/6Cm9uGyGCHw
#almostthere #ai #seq2seq #transformer
youtu.be/6Cm9uGyGCHw
text + voice + face animation in 1 second #ai #neurosync #a2f
YouTube video by NeuroSync | Realtime AudioToFace
youtu.be
November 24, 2024 at 12:10 PM
consistent 1 sec from speech in to speech out + face animation, with dynamic emotion based on emotion dimensions of the audio to face model. Now for quality data collection and scaling up of the model.
#almostthere #ai #seq2seq #transformer
youtu.be/6Cm9uGyGCHw
#almostthere #ai #seq2seq #transformer
youtu.be/6Cm9uGyGCHw
Dynamic emotion within the generated face animation, in realtime from audio. #almostthere
#ai #a2f #genai
@unrealengine.bsky.social
#ai #a2f #genai
@unrealengine.bsky.social
November 23, 2024 at 3:26 PM
Dynamic emotion within the generated face animation, in realtime from audio. #almostthere
#ai #a2f #genai
@unrealengine.bsky.social
#ai #a2f #genai
@unrealengine.bsky.social
www.youtube.com/watch?v=dX0k... RoPE improvements to NeuroSync's audio to face transformer model are starting to pay off! This partially trained model is more accurate than the previous model in 20% of the training time... #genaithatisuseful #ai #transformer #seq2seq @nvidiageforce.bsky.social
neurosync alpha : improved positional encoding #ai
YouTube video by NeuroSync | Realtime AudioToFace
www.youtube.com
November 19, 2024 at 4:01 PM
www.youtube.com/watch?v=dX0k... RoPE improvements to NeuroSync's audio to face transformer model are starting to pay off! This partially trained model is more accurate than the previous model in 20% of the training time... #genaithatisuseful #ai #transformer #seq2seq @nvidiageforce.bsky.social
huggingface.co/AnimaVR/NEUR... Text to Audio to Face Animation via LiveLink / UE5 | @UnrealEngine
#neurosync #ai #realtimeapi
#neurosync #ai #realtimeapi
AnimaVR/NEUROSYNC_Audio_To_Face_Blendshape · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
November 11, 2024 at 10:00 AM
huggingface.co/AnimaVR/NEUR... Text to Audio to Face Animation via LiveLink / UE5 | @UnrealEngine
#neurosync #ai #realtimeapi
#neurosync #ai #realtimeapi