TalkingHead-1KH is a talking-head dataset consisting of YouTube videos

Hi, the dataset is interesting. I get 3/4 black videos when generating the small dataset. I also notice that the trim function works from time to time when I modify the start/end_frames, though the beginning frames might be still black. Could anyone tell the reason and how to fix it?

I'm using ffmpeg 2.8.15 built with gcc 4.8.5, and ffmpeg-python 0.2.0.

Update: I also tested this command in terminal, but still get a black output video. So seems it's due to the version of ffmpeg?

ffmpeg -i -7TMJtnhiPM_0000.mp4 -vf trim=start_frame=50:end_frame=80 -an output80.mp4

Hi, thanks for releasing the dataset. I am facing a download issue:

File "/anaconda3/lib/python3.8/site-packages/pytube/cipher.py", line 301, in get_throttling_function_code code_lines_list = find_object_from_startpoint(js, match.span()[1]).split('\n') AttributeError: 'NoneType' object has no attribute 'span'

But a few days ago I successfully downloaded some. So I was wondering this is the issue for me only or for all? Btw, I have pytube.version='11.0.2'.

Hi, after running bash videos_download_and_crop.sh small I got this message and folder small/cropped_clips appears to be empty :

Using pool size of 8 File exists: --Y9imYnfBw File exists: -7TMJtnhiPM 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 7632.95it/s] Elapsed time: 0.02 videos_download_and_crop.sh: line 7: ./videos_split.sh: Permission denied Using pool size of 8 Input file small/1min_clips/--Y9imYnfBw_0000.mp4 does not exist, skipping Input file small/1min_clips/--Y9imYnfBw_0000.mp4 does not exist, skipping Input file small/1min_clips/-7TMJtnhiPM_0000.mp4 does not exist, skipping Input file small/1min_clips/-7TMJtnhiPM_0000.mp4 does not exist, skipping 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 12228.29it/s] Elapsed time: 0.02

UPDATE: It worked if I change ./videos_split.sh ${dataset}/raw_videos ${dataset}/1min_clips in videos_download_and_crop.sh to bash videos_split.sh ${dataset}/raw_videos ${dataset}/1min_clips

Thank you for sharing the dataset! That's really a great job! When I download and process the dataset, I find the amount of the train set is larger than the number listed in the paper "Implicit Warping for Animation with Image Set" (see figure). But the amount of the test set is smaller than the number in the paper. So the amount difference is caused from? I guess two possible cases：

1. The val_video_tubes.txt in the current repository is not complete.
2. The test set used in the paper additionally samples some videos from the train set?

I found that the dataset didn't specify identity.

So there will be many identities in one videos.

Could you provide any suggestion to split the identity too?

I fixed the problem with adding -reset_timestamp 1 when segmenting the videos

but still facing broken videos at the crop & trim stage

Then I found that

stream = ffmpeg.trim(stream, start_frame=S, end_frame=E+1)

will resulting in "some" broken videos (black, and instantly jump to the end)

There are still some videos works, but many trimmed videos are broken,

Could you provide any suggestion?

I think the annotations maybe totally wrong. why the same audio will corresponds to many different identity's crop? such like: several clips have a same segment in time line, and that means a same audio clip across different identity.

so, do you have the right annotation? can you update it?

Hi, I notice an issue when running videos_crop.py that is the trim range out of the video length. For example, this clipped video (attached), Ndnq9Ofs2eA_0022.mp4, has ~1 min time length, FPS=25.0, and a total of 1497 frames. But in train_video_tubes.txt, there is a given trim range, [1497, 1525] (raw 3, column 4-5), greater than the length of the video itself. The issue occurs on other videos as well, I haven't calculated how many times it happens just yet.

https://user-images.githubusercontent.com/27111467/153286974-bb63020c-34e6-40a4-8615-1ecd0ffe59db.mp4