Comments (4)
For better performance, will want to reduce the number of sources before finding popular entities.
This can be done by performing the scoring of sources based on target information first, then taking the top x% of scored sources and putting them into the popular info finder. Finally, can score the remaining sources based on popular information.
from auto-osint-v.
So for unknown reasons, when running PopularInformationFinder from within the unit_test works fine. However, when it is run from inside the PriorityManager class, nothing is generated with the multiprocessing.Pool.map function.
from auto-osint-v.
To finish:
- Fix the error message 'XMLParsedAsHTML' by switching the parser used in BS4, based on the website file type.
- Attempt to minimise the 'Token indices sequence length is longer than the specified maximum sequence length for this model.' warning.
- This can be reduced by changing the 'window' and 'stride' in the config of the model
- See Spacy Docs - strided_spans.v1
from auto-osint-v.
- Fix 'XMLParsedAsHTML' warning
- Reduce the 'Token indices' warning occurrence by modifying the window and stride fields in the model config.
from auto-osint-v.
Related Issues (20)
- Source Aggregation HOT 1
- Create the sentiment analyser. This first analysis will analyse the intelligence statement.
- Popular information finder HOT 4
- Final Summary of Sources
- Create Evidence Source Store
- Create Potential Corroboration Source Store
- Search Query Generator HOT 1
- Google Search HOT 2
- Social Media Search HOT 1
- Media Processor HOT 1
- Source Similarity Check HOT 4
- Sentiment analysis of key information & headlines
- Fix Sentiment/Semantic Analysis Confusion HOT 1
- Pylint github action is broken. Takes ages to install dependencies and still does not recognise import packages HOT 1
- Key information generator from source document
- Automatically create and deploy documentation.
- Feature: Attach sources to intel statement HOT 1
- Test and evaluate tool's performance HOT 1
- Final Report
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from auto-osint-v.