Danmakuly Predict Hist of Views

Scenario

  • When you just want to watch the climax of the contest video.
  • Or cut to the chase to a movie.
  • ......

Problem

  • Given a video => Predict the histogram of views

Data Format

histogram of views

Histogram of views

  • Lack of dataset
  • Class of video
    • Singing
    • Contest

Alternative way -- danmaku

Claims

  • More views, more danmaku

Dataset

Danmaku to Hist(GroundTruth)

  • Divide the length to N part
  • N = frames / bin_size
  • Count danmoku num of each part
  • Normalize

Training

Different approach

First attempt

  • bin_size = 4

Loss

Compare Hist

Second attempt

  • bin_size = 64

Third attempt

  • bin_size = 64
  • smooth

Fourth attempt

  • bin_size = 16
  • smooth

Discussion

  • Lack of Data
  • Oscillating Histogram

Difficulties

  • The model seems unable to learn such a oscillating histogram.
  • Sparsity of danmaku.
  • Maybe the relation between video frames and danmaku is not so strong.

Oscillating Histogram

  • Add audio data when generating video features.
  • Try other series prediction models, such as AR-based model.
  • Find and utilize periodic patterns of danmaku.

Future Research

Q&A

deck

By piepie01

deck

  • 376