Post subject: Suggestion: Controller input viewer
THC98
He/Him
Experienced player (920)
Joined: 8/7/2012
Posts: 279
Location: Brazil
Hey guys! Recently I was thinking about the idea of getting an input viewer in Dolphin. It may work as a plugin inside the emulator or as an external app. My idea is to replace the game screen to the GC controller responding to the inputs of a recorded movie (.dtm file) when the plugin is activated. That way it'd be possible to record the game normally once, then record it again with the plugin activated, and then get the videos together with a video editor. We wouldn't have to worry about the lags and framerate drops in this case, as both videos would already be done with a/v sync. If it was done with an external app though, we'd have to worry about the lags (maybe we could sync it with the timecodes.txt file that Dolphin generates, but I'm not sure). It shouldn't be hard to make this plugin / external app: we'd just have to replace the game screen by a black tile (if it's a plugin) and render a controller pic with all the buttons in separate files, and they move / change colors depending on the inputs that are read. Here it is an example of what it should look like (this video was made by mkdasher in Mupen 64 emulator, he used an external app to render the controller inputs and video edited all the lags): Link to video My main issue about making this myself is that I don't have any programming experience with emulators or external apps that could read recording files. I would appreciate if some programmer could help me with that! :)
Youtube Channel | Twitch Channel • Finished projects: GC Sonic Adventure DX - Sonic | GC Sonic Adventure DX - Tails | GC Sonic Adventure 2: Battle - Hero Story | GC Sonic Heroes - Team Sonic • Current projects: GC Sonic Adventure 2: Battle - Dark Story - 1st WIP • Paused projects: GC Sonic Adventure DX - Knuckles - 1st WIP • Individual levels records: Sonic Adventure DX | Sonic Adventure 2: Battle • My Discord: Tales98#0408
Post subject: Re: Suggestion: Controller input viewer
JosJuice
She/They
Editor, Emulator Coder
Joined: 7/3/2010
Posts: 193
Location: Sweden
THC98 wrote:
It shouldn't be hard to make this plugin / external app: we'd just have to replace the game screen by a black tile (if it's a plugin) and render a controller pic with all the buttons in separate files, and they move / change colors depending on the inputs that are read.
Another possibility is making a GameCube/Wii homebrew program that displays the pressed buttons. That would make it possible to use Dolphin's A/V recording and movie file input without any extra work, if I'm not mistaken.
Experienced player (588)
Joined: 2/5/2011
Posts: 1417
Location: France
Link to video This TAS has input viewer, but dunno how they did :/ (not original video tho, can't find original one.)
Current: Rayman 3 maybe? idk xD Paused: N64 Rayman 2 (with Funnyhair) GBA SMA 4 : E Reader (With TehSeven) TASVideos is like a quicksand, you get in, but you cannot quit the sand
Post subject: Re: Suggestion: Controller input viewer
Editor, Skilled player (1536)
Joined: 7/9/2010
Posts: 1319
THC98 wrote:
It may work as a plugin inside the emulator or as an external app.
You probably mean something like that. It is the built in lsnes movie editor.
Here it is an example of what it should look like
Single frame input viewers are pretty pointless, they don't give any advantage, you can't do non-linear TASing with them well. The lsnes movie editor works with normal savestates, not rewind (saving each frame like FCEUXs TAS Editor or BizHawks TAS Studio). I'm not sure if rewind would work out for GC/Wii. It should be possible to code a movie editor with savestates for Dolphin.
My idea is to replace the game screen to the GC controller responding to the inputs of a recorded movie (.dtm file) when the plugin is activated.
Why do you want to do that? It's not that hard to put a new window somewhere.
Favorite animal: STOCK Gt(ROSA)26Sortm1.1(rtTA,EGFP)Nagy Grm7Tg(SMN2)89Ahmb Smn1tm1Msd Tg(SMN2*delta7)4299Ahmb Tg(tetO-SMN2,-luc)#aAhmb/J YouTube Twitch
Post subject: Re: Suggestion: Controller input viewer
THC98
He/Him
Experienced player (920)
Joined: 8/7/2012
Posts: 279
Location: Brazil
TASeditor wrote:
Single frame input viewers are pretty pointless, they don't give any advantage, you can't do non-linear TASing with them well. The lsnes movie editor works with normal savestates, not rewind (saving each frame like FCEUXs TAS Editor or BizHawks TAS Studio). I'm not sure if rewind would work out for GC/Wii. It should be possible to code a movie editor with savestates for Dolphin. Why do you want to do that? It's not that hard to put a new window somewhere.
My idea isn't something to help while TASing (Dolphin already has a TAS Input that works very well). My idea is an input viewer for renders of TASes, pretty much what is seen at 19:06 in the video that got4n posted or in the example video I posted before.
Youtube Channel | Twitch Channel • Finished projects: GC Sonic Adventure DX - Sonic | GC Sonic Adventure DX - Tails | GC Sonic Adventure 2: Battle - Hero Story | GC Sonic Heroes - Team Sonic • Current projects: GC Sonic Adventure 2: Battle - Dark Story - 1st WIP • Paused projects: GC Sonic Adventure DX - Knuckles - 1st WIP • Individual levels records: Sonic Adventure DX | Sonic Adventure 2: Battle • My Discord: Tales98#0408
Post subject: Re: Suggestion: Controller input viewer
Editor, Skilled player (1536)
Joined: 7/9/2010
Posts: 1319
THC98 wrote:
My idea isn't something to help while TASing (Dolphin already has a TAS Input that works very well). My idea is an input viewer for renders of TASes, pretty much what is seen at 19:06 in the video that got4n posted or in the example video I posted before.
TAS input and movie editor are two completely different things. :) So you want an input display on screen? Encode the run, then overlay it with the input display and let buttons light up and move analog stick by also reading the dtm file.
Favorite animal: STOCK Gt(ROSA)26Sortm1.1(rtTA,EGFP)Nagy Grm7Tg(SMN2)89Ahmb Smn1tm1Msd Tg(SMN2*delta7)4299Ahmb Tg(tetO-SMN2,-luc)#aAhmb/J YouTube Twitch
Post subject: Re: Suggestion: Controller input viewer
THC98
He/Him
Experienced player (920)
Joined: 8/7/2012
Posts: 279
Location: Brazil
TASeditor wrote:
TAS input and movie editor are two completely different things. :) So you want an input display on screen? Encode the run, then overlay it with the input display and let buttons light up and move analog stick by also reading the dtm file.
Yeah that's my starting idea. The problem is that I'm not a programmer so I don't know how to do it... I know it's simple but I'd need some help :/
Youtube Channel | Twitch Channel • Finished projects: GC Sonic Adventure DX - Sonic | GC Sonic Adventure DX - Tails | GC Sonic Adventure 2: Battle - Hero Story | GC Sonic Heroes - Team Sonic • Current projects: GC Sonic Adventure 2: Battle - Dark Story - 1st WIP • Paused projects: GC Sonic Adventure DX - Knuckles - 1st WIP • Individual levels records: Sonic Adventure DX | Sonic Adventure 2: Battle • My Discord: Tales98#0408
Joined: 2/15/2009
Posts: 329
I don't like seeing the sloppy input. Holding A instead of pressing it on the exact frame for instance. Or alternating between two dialog skip buttons for 30 frames to skip 1 box. We need perfection!
Working on: Legend of Legaia, Vagrant Story
Joined: 9/3/2011
Posts: 26
bumping for interest EDIT: NintendoSpy is a program that does this for non-TAS runs https://github.com/jaburns/NintendoSpy a programmer-type person might be able to make this work for TAS runs. It is possible to get the gamecube controller display for "generic pc controller" which a guy on this thread did. https://forum.speeddemosarchive.com/post/all_controller_input_viewers_listing.html
THC98
He/Him
Experienced player (920)
Joined: 8/7/2012
Posts: 279
Location: Brazil
Naegleria wrote:
bumping for interest EDIT: NintendoSpy is a program that does this for non-TAS runs https://github.com/jaburns/NintendoSpy a programmer-type person might be able to make this work for TAS runs. It is possible to get the gamecube controller display for "generic pc controller" which a guy on this thread did. https://forum.speeddemosarchive.com/post/all_controller_input_viewers_listing.html
Wow, this is very interesting! I'm not really a programmer guy, so I can't do much with it. Can someone help us?
Youtube Channel | Twitch Channel • Finished projects: GC Sonic Adventure DX - Sonic | GC Sonic Adventure DX - Tails | GC Sonic Adventure 2: Battle - Hero Story | GC Sonic Heroes - Team Sonic • Current projects: GC Sonic Adventure 2: Battle - Dark Story - 1st WIP • Paused projects: GC Sonic Adventure DX - Knuckles - 1st WIP • Individual levels records: Sonic Adventure DX | Sonic Adventure 2: Battle • My Discord: Tales98#0408
Experienced player (588)
Joined: 2/5/2011
Posts: 1417
Location: France
If you're talking about the "Rayman" guy that's me lol, it was just configuration, but I'm not a programmer :/
Current: Rayman 3 maybe? idk xD Paused: N64 Rayman 2 (with Funnyhair) GBA SMA 4 : E Reader (With TehSeven) TASVideos is like a quicksand, you get in, but you cannot quit the sand