Comments (12)
do you get any solution to solve this problem?
from pytorch-vsumm-reinforce.
@zouying-sjtu
yes, i just input all features to KTS.
from pytorch-vsumm-reinforce.
@SinDongHwan can you share where you got this KTS code.
from pytorch-vsumm-reinforce.
@SinDongHwan http://lear.inrialpes.fr/people/potapov/med_summaries.php are you use this code? can you reach the performace that the paper provided. the reward hardly rises.
from pytorch-vsumm-reinforce.
@zouying-sjtu
yes, i used. i edited something
(https://github.com/SinDongHwan/pytorch-vsumm-reinforce/blob/master/utils/generate_dataset.py)
but i can't reach. change points of our and change points of dataset are differ.
i will test. how result.
from pytorch-vsumm-reinforce.
@thanks for your help, by the way, your code is very beautiful !
from pytorch-vsumm-reinforce.
@zouying-sjtu
No. hah i have to optimize codes...
from pytorch-vsumm-reinforce.
I tried KTS on SumMe, taking googlenet features as input as the paper stated.
First I don't know how to decide the number of change points (argument m in the cpd_auto function). Even if I set the same m as the the author did, the segmenting change points are totally different.
I tried KTS on both full frames and downsampled video, but still can reproduce the results in the *.h5 files.
Another thing confused me is that the fps of original videos are different, some of them ( for example cooking) are 15 fps. But all of them are treated as 30 fps and downsampled to 2 fps ( 15 times shorter). I am not sure if there would be some problems.
from pytorch-vsumm-reinforce.
I've faced to have different change points.
And I've had bad result when i used googlenet to extract features.
So, i tried to extract features using resnet101. this was a good result.
but change points was different.
I've not solved about change points difference.
in some papers, author said "use 1 or 2fps".
so i think if video has 15fps, 1fps downsampling.
This is just my think.
I tried KTS on SumMe, taking googlenet features as input as the paper stated.
First I don't know how to decide the number of change points (argument m in the cpd_auto function). Even if I set the same m as the the author did, the segmenting change points are totally different.
I tried KTS on both full frames and downsampled video, but still can reproduce the results in the *.h5 files.Another thing confused me is that the fps of original videos are different, some of them ( for example cooking) are 15 fps. But all of them are treated as 30 fps and downsampled to 2 fps ( 15 times shorter). I am not sure if there would be some problems.
from pytorch-vsumm-reinforce.
@SinDongHwan Thanks for your reply!
1.
So, i tried to extract features using resnet101. this was a good result.
How do you know resnet101 features generate good results?
I tried both googlenet and resnet101, using all the frames/2fps downsampled frames, but all the results are just bad.
I tried to figure out how to properly set maximum number of change points (npc in function cpd_auto()), because the algorithm should automatically compute the best number of chang points for me but it just didn't work. So I did an experiment on video Air_Force_One of summe, downsampled to 2fps, so there are 300 feature vectors. Then I set argument ncp=300, the resulting number of change points is 275, which is obviously wrong, beacuse there are only 30 change points in the .h5 file provided by the author of this code repo.
The original videos are not just 30 fps or 15 fps, some are 25 fps. Air_Force_One and Statue of Liberty in summe are 25 fps. Still, I don't know it matters or not.
from pytorch-vsumm-reinforce.
@JudeLiu Hello ,mate. have you solve the problem? I read the KTS paper and the code, but I still don't know how to set the maximum number of change points(nps). Looking forward to your reply,thx.
from pytorch-vsumm-reinforce.
You can refer ”Category-specific video summarization" by Danila Ptapov,Matthijs Douze, Zaid Harchaouni,Cordelia Schmid.
You can also refer https://github.com/TorRient/Video-Summarization-Pytorch and my repository( https://github.com/anaghazachariah/video_summary_generaton )
from pytorch-vsumm-reinforce.
Related Issues (20)
- Module Not Found Error HOT 15
- summary2video.py
- Question about Reward funtion ? HOT 1
- original Youtube and OVP datasets HOT 9
- How to find Reward Diversity score ?
- 0.0% Fscore for videos and probably wrong Summary. HOT 1
- Can not download the dataset.
- Could u tell me the relationship between 'gtscore' and 'gtsummary'? HOT 1
- Dataset for video summaization HOT 26
- Link to download dataset in repo is dead. HOT 2
- H5 dataset generation
- frame score
- Few Frame Ids from MachineSummary not available in VideoFrames generated. HOT 1
- Processed features and original videos HOT 1
- Problem with video index when running "summary2video.py" HOT 1
- GoogLe Net implementation HOT 5
- splits
- dist_mat = dist_mat.min(1, keepdim=True)[0] IndexError: Dimension out of range HOT 1
- DataSet Out of Date
- FileNotFoundError: [Errno 2] No such file or directory: 'path_to_your_model.pth.tar' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytorch-vsumm-reinforce.