Danmakuly Predict Hist of Views
Scenario
- When you just want to watch the climax of the contest video.
- Or cut to the chase to a movie.
- ......
Problem
- Given a video => Predict the histogram of views
Data Format
histogram of views
Histogram of views
- Lack of dataset
- Class of video
- Singing
- Contest
Alternative way -- danmaku
Claims
- More views, more danmaku
Dataset
- ~2500 Bilibili videos -- https://www.bilibili.com/
- length < 4 minutes
- danmaku number > 200, with time stamp
Danmaku to Hist(GroundTruth)
- Divide the length to N part
- N = frames / bin_size
- Count danmoku num of each part
- Normalize
Training
Different approach
First attempt
- bin_size = 4
Loss
Compare Hist
Second attempt
- bin_size = 64
Third attempt
- bin_size = 64
- smooth
Fourth attempt
- bin_size = 16
- smooth
Discussion
- Lack of Data
- Oscillating Histogram
Difficulties
- The model seems unable to learn such a oscillating histogram.
- Sparsity of danmaku.
- Maybe the relation between video frames and danmaku is not so strong.
Oscillating Histogram
- Add audio data when generating video features.
- Try other series prediction models, such as AR-based model.
- Find and utilize periodic patterns of danmaku.