The Nvidia 1050 Ti video card

I got 60 fps while playing 720 and 1080 videos, only with 480 videos
the fps drop to around 42 at all time

Change MPV player scale algorithm to nearest to see if this is the MPV issue but not helped.

Solved(2020/04/27):

The reason is turned on video fps interpolation by a misunderstanding.
True problem is sometimes the video behave discontinuous or drop frames.
Because video is 23.976 fps but monitor running on 60 fps.

Interpolation not just convert the frame interval but try to smooth between them.
This added a lot of resource consume. If just want to avoid frame interval problem
and not care about smooth, remove all interpolation options and add
video-sync=display-resample. It's almost zero performance cost.

Hi, I have been using your algorithm on top of NGU for the past 3 months or so. I have noticed that the hlsl version has not been updated in quite a while. I tried to convert the glsl shader to hlsl using glslang and SPIRV-Cross but I failed. I would like to know if you are going to update the hlsl version in the future or if there is an easier way to convert the glsl shader.

1
https://github.com/bloc97/Anime4K/blob/master/Java_Instructions.md how do you get the default upsampling scale first, by bicubic? or bilinear?of other methods? And then use the enhancement Anime4K method.

2
https://github.com/bloc97/Anime4K/blob/master/results/Graph.png?raw=true how do you get the perceptual quality?

Describe the bug I added the following line to my mpv input.conf

CTRL+8 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Restore_GAN_UUL.glsl:~~/shaders/Anime4K_Upscale_GAN_x4_UUL.glsl:~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"; show-text "Anime4K: Mode GAN (HQ)" Upon pressing CTRL+8, the video freezes while audio continues as normal. I am not even able to control mpv as normal and instead have to kill the process on the terminal.

To Reproduce Steps to reproduce the behavior:

1. Add the above line to your mpv config.
2. Play a low res anime show
3. Activate the shader
4. See error

Expected behavior I expected the video to be upscaled to some degree.

Screenshots Unable to take screenshots as the display just completely freezes.

Desktop (please complete the following information):

• OS: openSUSE Tumbleweed
• Version: Latest snapshot
• GPU/Version: Asus RX 6900XT with the current GPU drivers
• Media Player and Version: mpv v0.34

Additional context This was done using the latest pull of the master branch of Anime4k.

An semi-blindly edited config based on mode A with the CNN stages replaced with GAN seems to work, although the results are not as nice as I'd want.

CTRL+7 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Restore_GAN_UL.glsl:~~/shaders/Anime4K_Upscale_GAN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Upscale_GAN_x2_M.glsl"; show-text "Anime4K: Mode GAN"

Describe the bug Upon following the installation guide mentioned in the wiki, I expected the video to improve it's quality, however, SHIFT+I doesn't show anything.

I have to also mention the fact that I have also replaced the ";" with ":"

Although, mpv does seem to recognize that I do have Anime4K, as the keybinds clearly work.

To Reproduce Follow the instructions mentioned in wiki

Expected behavior Expected the shaders to apply

Screenshots Herein lie code blocks and screenshots

mpv.conf

sub-auto=fuzzy
profile=gpu-hq
glsl-shaders="~~/shaders/Anime4K_Denoise_Bilateral_Mode.glsl:~~/shaders/Anime4K_Deblur_DoG.glsl:~~/shaders/Anime4K_DarkLines_HQ.glsl:~~/shaders/Anime4K_ThinLines_HQ.glsl:~~/shaders/Anime4K_Upscale_CNN_M_x2_Deblur.glsl"

input.conf (This is extracted directly from the one in the wiki, with adjustments made for UNIX-based systems)

CTRL+1 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Restore_CNN_M.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode A (Fast)"
CTRL+2 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode B (Fast)"
CTRL+3 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode C (Fast)"
CTRL+4 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Restore_CNN_M.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl:~~/shaders/Anime4K_Restore_CNN_S.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode A+A (Fast)"
CTRL+5 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Restore_CNN_Soft_S.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode B+B (Fast)"
CTRL+6 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl:~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_M.glsl:~~/shaders/Anime4K_AutoDownscalePre_x2.glsl:~~/shaders/Anime4K_AutoDownscalePre_x4.glsl:~~/shaders/Anime4K_Restore_CNN_S.glsl:~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"; show-text "Anime4K: Mode C+A (Fast)"
CTRL+0 no-osd change-list glsl-shaders clr""; show-text "GLSL shaders cleared""

GLSL files in the shaders directory

Output of Shift+I 2 on mpv

Desktop (please complete the following information):

• OS: Ultramarine Linux(Fedora based distribution) 64 Bit
• Version: v4.0
• GPU: Nvidia GTX 1650
• Driver version: 495.46(X11)
• Media Player and Version: mpv 0.34.1
• Browser: Not applicable

Additional context Add any other context about the problem here.

Hi,

Noob here so please avoid my ignorance. I am not well versed with the field but would like to convert &/or view Anime. Even to 1080p of old once from 480p will be awesome!

I own a 2017 macPro with Raedon 560.

Thanks!

Hey,

I think it would be nice to have GLSL versions of this, especially since as far as I'm aware, a large portion of the more video-tweaky community often use's Linux and OpenGL based players like mpv, rather than DirectX.

As soon as I try to use the A+A(HQ) in mpv while watching a 1080p anime video, my video is only playing around 3 frames every 3 seconds, though the audio is fine. : CTRL+5 no-osd change-list glsl-shaders set "~~/shaders/Anime4K_Clamp_Highlights.glsl;~~/shaders/Anime4K_Restore_CNN_VL.glsl;~~/shaders/Anime4K_Upscale_CNN_x2_VL.glsl;~~/shaders/Anime4K_Restore_CNN_M.glsl;~~/shaders/Anime4K_AutoDownscalePre_x2.glsl;~~/shaders/Anime4K_AutoDownscalePre_x4.glsl;~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"; show-text "Anime4K: Mode A+A (HQ)"

I tried switching out some of the shaders to see which one was causing the issue. It turns out Anime4K_Upscale_CNN_x2_VL.glsl is the one giving me the trouble. If I switched to: Anime4K_Upscale_CNN_x2_M.glsl the problem goes away.

I noticed that the problem only presents itself if I tried to re-size or full-screen the video. If I just left the window size alone, the preset worked flawlessly.

To Reproduce Steps to reproduce the behavior:

1. Open a 1920x1080p anime video.
2. Full-screen the video
3. Enable the A+A(HQ) preset

Expected behavior Video frames start to insanely lag, producing only a couple of frames every few seconds. The audio remains unchanged.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: Windows 10 -Monitor Resolution: 3440x1440
• Version: 10.0.19043 Build 19043
• GPU: RTX 2080 Super
• Media Player and Version: MPV v0.33
• Browser (If applicable) [e.g. chrome, safari]

Additional context My mpv.conf: `#

THIS FILE WILL BE OVERWRITTEN WITH THE PACKAGE UPDATE

Use %APPDATA%/mpv/mpv.conf

OR SVP's menu -> Information -> Add. information -> mpv config. file

to define your own customized configuration

Sample mpv configuration

this is required for SVP to "catch" the mpv

input-ipc-server=mpvpipe

hardware video decoder

hwdec=auto-copy hwdec-codecs=all

sub-font-size=40

increase subtitle font size

ALT+k add sub-scale +0.1

decrease subtitle font size

ALT+j add sub-scale -0.1

high quality video output, require rather fast video card

D3D11 renderer (default) is required for the HDR playback

profile=gpu-hq gpu-api=d3d11 scale=ewa_lanczossharp cscale=ewa_lanczossharp video-sync=display-resample

miscellaneous options

comment this one if you want mpv to remember the playback position

save-position-on-quit=no

fixes audio desync

hr-seek-framedrop=no

"ReClock" replacement

#video-sync=display-resample #video-sync-max-video-change=5

#log-file=mpv.log

increase subtitle font size

ALT+k add sub-scale +0.1

decrease subtitle font size

ALT+j add sub-scale -0.1 `

Hi, sorry for the late PR :P

Haven't had much time recently so I just managed to squeeze this in

Do need a little bit of revamp for Windows. Won't mind doing it if requested

Alternatively, this can be merged into the wiki as i believe it makes much more sense to put it in there

Also, I have added a small change to the Issue Template for bugs to give more details for Linux users, just to make it a bit more easier to troubleshoot

Describe the bug This is release link of 4.0.1:
https://github.com/bloc97/Anime4K/releases/tag/v4.0.1

The assets area have a zip file called Anime4K_v4.0.zip
This zip file got SHA256 139CD282086457C5ADC79CAF7B75B8B825091D71C9B54958C18745FEA62D7ED7
It's a same file to early 4.0 version, not new 4.1.

To Reproduce Steps to reproduce the behavior:

1. Go to 'https://github.com/bloc97/Anime4K/releases/tag/v4.0.1'
2. Click on 'Anime4K_v4.0.zip'

Expected behavior Release archive for 4.0.1 version.

Screenshots

Desktop (please complete the following information):

• OS: e.g. Windows 10
• Version v4.0.1
• GPU e.g. GTX 1080
• Media Player and Version e.g. MPV
• Browser e.g. chrome

Additional context

I know that you are probably busy with other things. But I'm still waiting for details on v3.0 to use it. It's just that it looks like you forgot. Anyway, thanks for your shader, I love it!

Thank you for your excellent work in Anime4K！ Now I am trying to learn and train the contents of the "Tensorflow" folder, so may I request to get the "/hdd/sdb/SYNLA_Plus_4096.npy" which is used in the Train_Model.ipynb? I'd appreciate it if you would tell me~

Hi,

I'm a software dev who uses Scala at work. I would like to learn more about AI and deep learning and was amazed by your work here. I was hoping you could give me pointers on how I could learn this specific field of AI better to hopefully make useful software for animators and artists one day.

How much theory should I go and learn? I learned programming by lots of self projects. I enjoy reading research papers. Would you recommend going through with them and experimenting?

Much thanks!

Fortunately I was able to follow this guide (https://atlassc.net/2022/01/05/anime4k-on-m1-max/) and got it to work. The article OP only specifies a single profile but I went ahead and made the equivalent profiles for the modes in the Windows and Linux instructions, as seen below. Feel free to add them to a macOS install guide.

# mpv.conf

[Anime4K_A_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_B_B]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_B]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_C_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_C]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_VL.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"

[Anime4K_Fast_A_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_S.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

[Anime4K_Fast_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

[Anime4K_Fast_B_B]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_S.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

[Anime4K_Fast_B]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_Soft_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

[Anime4K_Fast_C_A]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Restore_CNN_S.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

[Anime4K_Fast_C]
glsl-shaders-append="~~/shaders/Anime4K_Clamp_Highlights.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_Denoise_CNN_x2_M.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x2.glsl"
glsl-shaders-append="~~/shaders/Anime4K_AutoDownscalePre_x4.glsl"
glsl-shaders-append="~~/shaders/Anime4K_Upscale_CNN_x2_S.glsl"

# input.conf

# High end variants
CTRL+1 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_A_A"; show-text "Profile: Anime4K_A_A"
CTRL+2 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_A"; show-text "Profile: Anime4K_A"
CTRL+3 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_B_B"; show-text "Profile: Anime4K_B_B"
CTRL+4 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_B"; show-text "Profile: Anime4K_B"
CTRL+5 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_C_A"; show-text "Profile: Anime4K_C_A"
CTRL+6 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_C"; show-text "Profile: Anime4K_C"

# Fast variants
CTRL+1 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_A_A"; show-text "Profile: Anime4K_Fast_A_A"
CTRL+2 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_A"; show-text "Profile: Anime4K_Fast_A"
CTRL+3 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_B_B"; show-text "Profile: Anime4K_Fast_B_B"
CTRL+4 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_B"; show-text "Profile: Anime4K_Fast_B"
CTRL+5 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_C_A"; show-text "Profile: Anime4K_Fast_C_A"
CTRL+6 no-osd change-list glsl-shaders clr ""; apply-profile "Anime4K_Fast_C"; show-text "Profile: Anime4K_Fast_C"

I'd like to render image by GLSurfaceView and make the image clearer, but I don't know how to use the anime4k related glsl files. Do you have any suggestions?

1. Updated fedora workstation/spins guide : As mpv is not available in the main official fedora repos, we've to add RPM-Fusion repos.
2. Added Flatpak guide.
3. Added new version(latest) screenshot in "Usage Instructions for Anime4K section"
4. Added a note and a tip for fedora and flatpak guide.

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.