xuwenyihust/lunaticlog

Fake HTTP log generator module, test if your monitor system can survive under the log spikes.

Hi there 👋

lunaticlog's Issues

Log Rotatation

Test param: lines

Install via pip does not work

Mac OS, brew installed python3.

$ virtualenv tmp
$ cd tmp
$ source bin/activate
(tmp) $ pip3 install lunaticlog
Collecting lunaticlog
Installing collected packages: lunaticlog
Successfully installed lunaticlog-0.1.2

(tmp) $ python
Python 3.7.2 (v3.7.2:9a3ffc0492, Dec 24 2018, 02:44:43)
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.

import lunaticlog
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'lunaticlog'

(tmp) $ pip3 list
Package Version

---

lunaticlog 0.1.2
pip 19.1.1
setuptools 41.0.1
wheel 0.33.4

The distinfo is there, but not the code.
$ ls lib/python3.7/site-packages/
pycache pip-19.1.1.dist-info src
easy_install.py pkg_resources tests
lunaticlog-0.1.2.dist-info setuptools wheel
pip setuptools-41.0.1.dist-info wheel-0.33.4.dist-info

If I clone the repo into the site-packages directory, then it works. (I have to manually add numpy)
(tmp) $ pip3 install numpy
(tmp) $ cd lib/python3.7/site-packages/
(tmp) $ git clone https://github.com/xuwenyihust/lunaticlog.git
Cloning into 'lunaticlog'...
remote: Enumerating objects: 919, done.
remote: Total 919 (delta 0), reused 0 (delta 0), pack-reused 919
Receiving objects: 100% (919/919), 5.36 MiB | 3.00 MiB/s, done.
Resolving deltas: 100% (439/439), done.
(tmp) $ python
Python 3.7.2 (v3.7.2:9a3ffc0492, Dec 24 2018, 02:44:43)
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import lunaticlog
>>>

Add HTTP methods distribution control

Use numpy module to control the HTTP methods distribution.

Add log generator mode control.

• normal mode - uniform distribution between interval min & max
• spike mode - generate periodic spikes
• push mode - generate logs at highest rate (min interval assigned)

Prototype

Write a prototype to achive the main functionality: generate fake apache logs.

Configure diff output methods

• .log file

• STDOUT

• .gz file

Add README 'Usage' paragraph

Meet dependencies, parameters.

Add CI support

Add tests

Migrate to new PyPI API

Add assertions to make debugging easier

Default parameters

Assign default values to parameters in case not supplied by users.

Add npm support.

Add npm support to automatically release to PyPI.

Separate base class & other concrete classes in diff files

Change coverage conf

Add requirements.txt

Add the requirements.txt.

Test apache access log HTTP methods

Test separately when apache class is requested to generate diff HTTP methods.

Add README Apache log format

Introduce the apache log format.

Complement attribute constraints & tests

Add test_access_lines()

Add Apche log access lines.

Random intervals. Default field contents.

Add testcase coverage support

Base log generator class

FileNotFoundError: [Errno 2] No such file or directory: './config/apache_gen.json'

how to tackle this issue, i am following the step written in documentation

Contributing guidelines

Write contributing guidelines.

Complete test_hearbeat_lines()

Move parameter handlers into classes

More testable

Re-write functions to make them more testable.

Update README & distribute to PyPI

Distribute to PyPI

Package & distribute to PyPI.

Complete basic documentation

Create a bandwidth monitor

Update README

Usage

Add license & install to README

Add configuration file.

Add a configuration file to configure the Apache access line:

• user_id
• method
• resource
• version

More unit tests

Add more unit tests.

More tests

Find a better solution for spikes mode

Build a config system for possible log field contents

JSON
Centralized interface to these data

Amazon S3 log format support

Add Sphinx docs

Parameter checking

Nginx log format support

Take advantages of @property