Skip to content

niherhalder/Threat_Intelligence_Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Error in user YAML: (<unknown>): found character that cannot start any token while scanning for the next token at line 3 column 18
---

## Version

Current Version: `v1.0`

### v1.0 Features
- Multi-source cybersecurity news scraping
- CSV export
- XLSX export with auto-adjusted columns
- Formatted threat intelligence report generation
- Screenshot documentation
- Automated execution workflow
# Threat Intelligence Scraper

Python-based cybersecurity threat intelligence scraper that collects the latest security news from multiple cybersecurity sources and exports structured threat data into CSV, XLSX, and formatted report files.

---

Features

  • Collects cybersecurity threat intelligence articles
  • Scrapes multiple security news sources
  • Exports structured threat data to CSV
  • Generates formatted Excel reports (.xlsx)
  • Automatically adjusts Excel column widths
  • Generates formatted threat intelligence report
  • Stores article title, source, link, and scrape time
  • Includes screenshots and execution proof

Technologies Used

  • Python
  • Requests
  • BeautifulSoup4
  • OpenPyXL
  • CSV handling
  • Cybersecurity OSINT concepts

Sources Used

  • The Hacker News
  • Krebs on Security
  • SecurityWeek

Project Structure

Threat_Intelligence_Scraper/
│
├── scraper.py
├── requirements.txt
├── README.md
├── threats.csv
├── threats.xlsx
├── threat_report.txt
├── .gitignore
└── screenshots/
    ├── terminal_execution.png
    ├── excel_output.png
    ├── csv_output.png
    ├── threat_report.png
    └── project_folder.png

Installation

Install dependencies:

pip install -r requirements.txt

Run the Project

python scraper.py

Output Files

The script generates:

  • threats.csv
  • threats.xlsx
  • threat_report.txt

Sample Data Collected

  • Threat article titles
  • Source name
  • Article links
  • Scraped timestamps

Screenshots

Project screenshots are available in the screenshots folder.


Future Improvements

  • Add severity classification
  • Add malware/phishing/ransomware categorization
  • Add dashboard visualization
  • Add automated scheduling
  • Export to PDF reports
  • Add IOC extraction

Author

Niher Halder

Cybersecurity | AI Security | OT/ICS Security | Python Automation

About

Python-based threat intelligence scraper and cybersecurity monitoring automation project.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages