Christian Herdtweck [Wed, 14 Nov 2018 10:34:41 +0000]
Disable debug output in log_read
Fixed based on Plamen's review.
Christian Herdtweck [Wed, 5 Dec 2018 15:27:18 +0000]
Create 2 pyi2ncommon rpms: for py3.3 and py3.6
The python version, for which pyi2ncommon is installed on target machine,
is fixed in the rpm. It defaults to same version as build host. Managed
to change that by creating setup.cfg file dynamically while running
setup.py . With help of that script, can now create one version for
autotest (py3.6) and one for I2n systems (py3.3)
Christian Herdtweck [Wed, 5 Dec 2018 15:22:41 +0000]
Do not require fixed python3 version for pyi2ncommon
Christian Herdtweck [Wed, 14 Nov 2018 10:33:26 +0000]
Reduce output from simple_cnf test to warnings
Christian Herdtweck [Wed, 14 Nov 2018 09:53:10 +0000]
Replace deprecated logging function with equivalent
Christian Herdtweck [Wed, 14 Nov 2018 09:53:02 +0000]
Replace deprecated unittest function with equivalent
Christian Herdtweck [Wed, 14 Nov 2018 08:53:08 +0000]
Ensure all opened files/sockets are closed in mail_utils
Philipp Gesang [Thu, 25 Oct 2018 08:47:42 +0000]
bump minor version to keep track of changes
Christian Herdtweck [Mon, 5 Nov 2018 11:22:07 +0000]
Merge branch 'util-resurrection'
Christian Herdtweck [Mon, 5 Nov 2018 10:30:40 +0000]
Fix doc strings for text_helpers (except color stuff)
Thanks to Plamen for hint in review
Christian Herdtweck [Mon, 5 Nov 2018 10:23:34 +0000]
Fix doc string for sysmisc.cd()
Thanks to Plamen for hint
Christian Herdtweck [Mon, 29 Oct 2018 08:56:35 +0000]
Create unittest for size_str
Christian Herdtweck [Mon, 29 Oct 2018 08:56:27 +0000]
Bring back size_str text helper
Had been removed since it was not needed any more. Is needed again, so may
be relevant after all
Christian Herdtweck [Mon, 29 Oct 2018 08:41:47 +0000]
Create unit tests for cd context manager
Christian Herdtweck [Mon, 29 Oct 2018 08:41:37 +0000]
Bring back cd context manager
This has been in pyi2ncommon before but was removed since it was only used
in one place (which exists no more). Now needed it again, so bring it back.
Christian Herdtweck [Mon, 5 Nov 2018 11:21:17 +0000]
Merge branch 'cnfvar-dev'
Philipp Gesang [Mon, 5 Nov 2018 09:47:49 +0000]
fix misleading error message in simple_cnf
Philipp Gesang [Mon, 5 Nov 2018 09:39:12 +0000]
normalize varname as cnfvar.py expects it
When cnfvar reads variables, it normalizes the names to
lowercase. Only when emitting classic CNF_FILE style output
the names are uppercased for set_cnf.
Philipp Gesang [Mon, 5 Nov 2018 09:12:35 +0000]
support comparison of SimpleCnf() with non-SimpleCnf() objects
Since __eq__ operations are polymorphic, crashing on different
``types'' is not a good idea.
Philipp Gesang [Mon, 5 Nov 2018 08:58:43 +0000]
validate SimpleCnf inputs
The cnfvar functions cannot handle ``tuple'' inputs since the
inputs are variable length. Make simple_cnf pass a list instead
and reject non-list inputs in the ctor.
Philipp Gesang [Mon, 5 Nov 2018 08:21:49 +0000]
restore simple_cnf/add_single API
Restore an API that vanished at some point despite there still
being users.
This is commit
fa747d25a7c47a1ceef165c4e1667b9755c9da0d on
autotest/i2n. The original commit message in full:
In
commit
5f6735c41fc769ac9ba6ee62754ab2b7da3d68d2
Author: Christian Herdtweck <christian.herdtweck@intra2net.com>
Date: Wed Apr 5 18:14:02 2017 +0200
Extend SimpleCnf.add_single to SimpleCnf.add
this ApI was folded into .add() without providing an overload for
downstream consumers. Provide the symbol again as a thin wrapper
around .add() and hope for the behavior to remain unaffected.
Philipp Gesang [Tue, 24 Jul 2018 13:46:54 +0000]
fix cnfvar crash on end inside child vars
The recursive call to parse_cnf_children() may also return None
if it hit EOF.
Philipp Gesang [Fri, 8 Dec 2017 12:34:46 +0000]
lowercase all incoming varnames
The CNF store is case-indifferent regarding variable names when
reading from it, so just normalize all of them when internalizing
variables.
Philipp Gesang [Tue, 5 Dec 2017 12:47:45 +0000]
when emitting CNF lines, force capitalization of variable names
Philipp Gesang [Tue, 5 Dec 2017 12:46:47 +0000]
add cnfvar helper for counting CNF trees
Philipp Gesang [Tue, 5 Dec 2017 10:55:24 +0000]
allow parent-less renumbering of CNF_VARs
When more control is needed over the line numbers a CNF_VAR and
its children are assigned, the *parent* linenumber can be used to
pass an offset. Add a parameter *toplevel* to prevent the parent
index from being set.
Philipp Gesang [Tue, 5 Dec 2017 10:38:40 +0000]
loosen criteria on CNF object roots
Single CNF_VARs are technically malformed since CNF file is
always a list of vars. However, any isolated CNF line can be
trivially converted to a valid CNF_VAR by wrapping it in a list
ctor, so do that automatically when determining the root of a
CNF_VAR.
Philipp Gesang [Tue, 5 Dec 2017 10:02:18 +0000]
fix renumbering in cnfvar.py
Philipp Gesang [Fri, 1 Dec 2017 15:14:56 +0000]
avoid formatting binary strings
Postpone bytes conversion of CNF-encoded objects until the last
moment to work around missing interpolation of bytes objects in
Python 3.3 (the version still in use on the Intranator).
Reference: https://bufs.python.org/issue3982
Christian Herdtweck [Wed, 24 Oct 2018 09:51:37 +0000]
Update version to 1.3
Plamen Dimitrov [Tue, 30 Oct 2018 15:12:27 +0000]
Use HTTP firewall ruleset option starting from I2N release 6.5.0
Christian Herdtweck [Wed, 24 Oct 2018 15:30:27 +0000]
Fix encoding issue when building rpm
This issue never occured in regular shells because usually LOCALE and
system encoding and similar is set.
Christian Herdtweck [Wed, 24 Oct 2018 14:40:22 +0000]
Add CONTRIBUTING guide with rules for contributors
Christian Herdtweck [Wed, 24 Oct 2018 13:18:52 +0000]
Make debug print in test optional
Christian Herdtweck [Wed, 24 Oct 2018 13:11:27 +0000]
Fix units and threshold for log read test
Christian Herdtweck [Wed, 24 Oct 2018 13:09:03 +0000]
Fix cnf var unit test: cnf lines can have different order
Plamen Dimitrov [Mon, 5 Nov 2018 08:58:14 +0000]
Merge branch 'autotest-migration' into master
This branch migrates all utilities originally developed for Autotest but
considered generalizable beyond its scope and useful for other projects
requiring python bindings for I2N related functionality.
Any future improvement and refactoring on the contributed modules will
be done here and made available for client code including Autotest.
Plamen Dimitrov [Sun, 30 Sep 2018 05:20:10 +0000]
Include the cnfline subpackage in the setuptools script
Plamen Dimitrov [Tue, 16 Oct 2018 19:28:21 +0000]
Avoid creating unclean debug directories during build cnfvar unit tests
Plamen Dimitrov [Wed, 26 Sep 2018 15:20:53 +0000]
Remove arnied utility stub now that the actual wrapper is available
Plamen Dimitrov [Thu, 4 Oct 2018 04:45:32 +0000]
Backport some subprocess py3.5+ functionality for older python versions
The main platform using these utilities only supports py3.3 making
this extra effort necessary for a seamless caller experience.
Plamen Dimitrov [Tue, 23 Oct 2018 07:58:13 +0000]
Restrict the logging to pyi2ncommon namespace
The logging for the entire library can be managed through its
root logger and thus of all migrated functionality.
Plamen Dimitrov [Tue, 23 Oct 2018 07:58:26 +0000]
Use the correct sourcing for all added unit tests
Plamen Dimitrov [Wed, 26 Sep 2018 15:25:19 +0000]
Adapt all internal imports in relative fashion
We were modifying the system path before but now we can use
cleaner importing approach.
Plamen Dimitrov [Sun, 23 Sep 2018 16:45:39 +0000]
Add GPLv2 licensing headers to all migrated utilities
Plamen Dimitrov [Sun, 23 Sep 2018 16:27:00 +0000]
Migrate utilities from the autotest-intra2net repo
Plamen Dimitrov [Fri, 15 Jun 2018 18:12:12 +0000]
Use the system independent null device provided by python
Plamen Dimitrov [Fri, 15 Jun 2018 18:11:44 +0000]
Convert configs to bytes to make some unit tests work with cnfvar
Plamen Dimitrov [Fri, 15 Jun 2018 18:02:44 +0000]
Unify the cnf reading API to bytes argument and returned str
Also fix byte usage in config preparation with the above assumption.
Christian Herdtweck [Tue, 9 Oct 2018 08:15:49 +0000]
Update library description, remove autotest
Christian Herdtweck [Tue, 9 Oct 2018 07:44:32 +0000]
Fix iter_helper import and test
Christian Herdtweck [Mon, 8 Oct 2018 07:44:02 +0000]
Bring back call helpers
Were not used sofar but will be extendend and used again by autotest code
Christian Herdtweck [Mon, 8 Oct 2018 07:39:38 +0000]
Merge branch 'zip-stream-test'
Christian Herdtweck [Thu, 24 May 2018 10:29:49 +0000]
Fix error wrapping stdout when redirecting
In some cases (e.g. redirecting stdout to shell), the automatic determination
in ZipFile constructor whether its file argument can seek() and tell() fails.
stdout seems to support both but returns bogus values for tell(), resulting
in negative sizes when writing the archive's end record.
Provide a fix with additional arg force_wrap
Also ensure that CRCs are always correct as suggested in python docs and
stackoverflow
Christian Herdtweck [Wed, 23 May 2018 10:36:03 +0000]
Simplify imports in zip_stream and add comments
Christian Herdtweck [Wed, 23 May 2018 10:35:02 +0000]
Create unittest for zip_stream
Only runs in python3 (zipfile35 could be made py2-compatible by importing
print() and removing PyZipFile, but also have trouble with byte sizes in
struct.pack)
Christian Herdtweck [Fri, 15 Jun 2018 09:06:26 +0000]
Create unittest for argpars_helpers
Christian Herdtweck [Fri, 15 Jun 2018 09:06:02 +0000]
Create new arparse_helpers with NonExitingParser and existing_file
Christian Herdtweck [Fri, 22 Jun 2018 12:09:49 +0000]
Created unittest for iter_helpers
Christian Herdtweck [Fri, 22 Jun 2018 12:09:30 +0000]
Create iter_helper interesting_repetition
Christian Herdtweck [Mon, 8 Oct 2018 07:29:39 +0000]
Merge clean-up branch
Christian Herdtweck [Tue, 2 Oct 2018 08:37:00 +0000]
Update README
Christian Herdtweck [Tue, 2 Oct 2018 08:36:50 +0000]
Fix comments in check.sh
Christian Herdtweck [Tue, 2 Oct 2018 08:36:33 +0000]
Mention autotest in setup.py, update template files
Christian Herdtweck [Tue, 2 Oct 2018 08:35:55 +0000]
Fix whitespace in comments in template
Christian Herdtweck [Tue, 2 Oct 2018 08:35:06 +0000]
Finally break ties with python2
Christian Herdtweck [Tue, 2 Oct 2018 08:02:54 +0000]
Remove unused test_helpers
Christian Herdtweck [Tue, 2 Oct 2018 08:01:12 +0000]
Replace only usage of test_helpers
Christian Herdtweck [Tue, 2 Oct 2018 08:00:54 +0000]
Remove unused call_helpers
Christian Herdtweck [Mon, 8 Oct 2018 07:27:14 +0000]
Remove deprecated log reader utility
Use log_read instead
Christian Herdtweck [Mon, 8 Oct 2018 07:26:43 +0000]
Remove old unused file helpers
Half-baked re-implementation of psutils, no good
Christian Herdtweck [Fri, 3 Aug 2018 13:52:56 +0000]
Fix name of project in doc config
Christian Herdtweck [Fri, 3 Aug 2018 13:45:55 +0000]
Create sphinx docu only of src, not of test
Christian Herdtweck [Fri, 3 Aug 2018 13:45:32 +0000]
Update copyright in sphinx docu
Christian Herdtweck [Fri, 3 Aug 2018 13:28:09 +0000]
Correct formatting of comments in template, add some more text
Christian Herdtweck [Fri, 3 Aug 2018 13:27:44 +0000]
Unify license, copyright and author information
Christian Herdtweck [Mon, 18 Jun 2018 08:17:49 +0000]
Fixed one error and some whitespace found by pycharm
Christian Herdtweck [Fri, 15 Jun 2018 11:15:55 +0000]
Make a note in file_helpers to use psutils instead of re-implementing it
Christian Herdtweck [Tue, 22 May 2018 10:56:17 +0000]
Merge branch 'install-subdir'
Christian Herdtweck [Tue, 22 May 2018 10:33:30 +0000]
Skip CnfVar unittests
These tests seem to never have worked
Christian Herdtweck [Tue, 22 May 2018 10:11:34 +0000]
Clarify that disc_filler is no unittest
Christian Herdtweck [Tue, 22 May 2018 10:11:18 +0000]
Replace non-ascii char in cnfvar, import print from future
Christian Herdtweck [Tue, 22 May 2018 10:07:42 +0000]
Rename cnfvar unittest so it is actually being found and used
Christian Herdtweck [Tue, 22 May 2018 09:58:50 +0000]
Make all internal imports relative
Christian Herdtweck [Tue, 22 May 2018 09:51:14 +0000]
Remove test code from zip_stream module, add comments
Christian Herdtweck [Tue, 22 May 2018 09:34:55 +0000]
Increase version to 1.2
Christian Herdtweck [Tue, 22 May 2018 09:34:42 +0000]
Install into subdir pyi2ncommon in site-packages
Before, all files src/*.py were just copied to /usr/lib/pythonX.X/site-packages
Christian Herdtweck [Tue, 22 May 2018 10:09:07 +0000]
Move template for tests to template dir
Christian Herdtweck [Tue, 22 May 2018 10:34:53 +0000]
Merge branch 'zip-stream'
Christian Herdtweck [Tue, 22 May 2018 09:33:44 +0000]
Create template subdir, move template there
Could otherwise not get template.py out of installed code
Plamen Dimitrov [Mon, 12 Sep 2016 15:08:13 +0000]
Add a TODO to track current development directions.
Christian Herdtweck [Fri, 18 May 2018 13:57:04 +0000]
Create a streamable version of ZipFile
Python's ZipFile requires data in memory or on disc in order to compress it.
This module contains class ZipStream that extends ZipFile to allow read-only,
non-seekable streams as input.
For python < 3.5 this requires python-zipfile35; implementation is MUCH simpler
for python >= 3.6
Christian Herdtweck [Fri, 2 Feb 2018 12:58:42 +0000]
Do not color output to non-terminal; improve print() arg handling
Christian Herdtweck [Thu, 14 Dec 2017 10:45:37 +0000]
Handle missing parameters to log string
Christian Herdtweck [Wed, 6 Dec 2017 12:20:51 +0000]
More output from test to simplify debugging; set thresh back to 1s
Christian Herdtweck [Wed, 6 Dec 2017 12:16:01 +0000]
Use a monotonic wall clock for performance tests also in py2
This fixes the problem enountered sometimes in unittest test_log_read. The
clock was not precise enough (10ms beat)
Christian Herdtweck [Wed, 6 Dec 2017 12:15:12 +0000]
Make src and test a package by adding __init__.py
Christian Herdtweck [Wed, 6 Dec 2017 12:14:51 +0000]
Make sure unittests only import from src
Before, the imports could have been from an earlier installed version of
pyi2ncommon.
Christian Herdtweck [Wed, 6 Dec 2017 09:46:32 +0000]
Skip unittest that fails when building rpm
Test succeeds if running unittests on shell, but fails when building rpm.
For some reason there is an extra thread that behaves unexpected.
Christian Herdtweck [Fri, 1 Dec 2017 15:33:05 +0000]
Merge branch 'cnfvar-py'