🛠️ Welcome to Stouputils Documentation#
Versions: latest, v1.9.3, v1.9.2, v1.9.1, v1.9.0, v1.8.0, v1.7.3, v1.6.6, v1.5.4, v1.4.8, v1.3.23, v1.2.40, v1.0.22
🛠️ Project Badges#
📚 Project Overview#
Stouputils is a collection of utility modules designed to simplify and enhance the development process.
It includes a range of tools for tasks such as execution of doctests, display utilities, decorators, as well as context managers.
🔧 Installation#
pip install stouputils
✨ Enable Tab Completion on Linux (Optional)#
For a better CLI experience, enable bash tab completion:
# Option 1: Using argcomplete's global activation
activate-global-python-argcomplete --user
# Option 2: Manual setup for bash
register-python-argcomplete stouputils >> ~/.bashrc
source ~/.bashrc
After enabling completion, you can use <TAB> to autocomplete commands:
stouputils <TAB> # Shows: --version, -v, all_doctests, backup
stouputils all_<TAB> # Completes to: all_doctests
Note: Tab completion works best in bash, zsh, Git Bash, or WSL on Windows.
🚀 Project File Tree#
stouputils/ ├── applications/ │ ├── automatic_docs.py # 📚 Documentation generation utilities (used to create this documentation) │ ├── upscaler/ # 🔎 Image & Video upscaler (configurable) │ └── ... │ ├── continuous_delivery/ │ ├── cd_utils.py # 🔧 Utilities for continuous delivery │ ├── github.py # 📦 Utilities for continuous delivery on GitHub (upload_to_github) │ ├── pypi.py # 📦 Utilities for PyPI (pypi_full_routine) │ ├── pyproject.py # 📝 Utilities for reading, writing and managing pyproject.toml files │ ├── stubs.py # 📝 Utilities for generating stub files using stubgen │ └── ... │ ├── data_science/ │ ├── config/ # ⚙️ Configuration utilities for data science │ ├── dataset/ # 📊 Dataset handling (dataset, dataset_loader, grouping_strategy) │ ├── data_processing/ # 🔄 Data processing utilities (image augmentation, preprocessing) │ │ ├── image/ # 🖼️ Image processing techniques │ │ └── ... │ ├── models/ # 🧠 ML/DL model interfaces and implementations │ │ ├── keras/ # 🤖 Keras model implementations │ │ ├── keras_utils/ # 🛠️ Keras utilities (callbacks, losses, visualizations) │ │ └── ... │ ├── scripts/ # 📜 Data science scripts (augment, preprocess, routine) │ ├── metric_utils.py # 📏 Static methods for calculating various ML metrics │ ├── mlflow_utils.py # 📊 Utility functions for working with MLflow │ └── ... │ ├── installer/ │ ├── common.py # 🔧 Common functions used by the Linux and Windows installers modules │ ├── downloader.py # ⬇️ Functions for downloading and installing programs from URLs │ ├── linux.py # 🐧 Linux/macOS specific implementations for installation │ ├── main.py # 🚀 Core installation functions for installing programs from zip files or URLs │ ├── windows.py # 💻 Windows specific implementations for installation │ └── ... │ ├── all_doctests.py # ✅ Run all doctests for all modules in a given directory ├── archive.py # 📦 Functions for creating and managing archives ├── backup.py # 💾 Utilities for backup management (delta backup, consolidate) ├── collections.py # 🧰 Utilities for collection manipulation (unique_list, sort_dict_keys, upsert_in_dataframe, array_to_disk) ├── ctx.py # 🔇 Context managers (Muffle, LogToFile, MeasureTime, DoNothing) ├── decorators.py # 🎯 Decorators (measure_time, handle_error, timeout, retry, simple_cache, abstract, deprecated, silent) ├── image.py # 🖼️ Little utilities for image processing (image_resize, auto_crop, numpy_to_gif, numpy_to_obj) ├── io.py # 💾 Utilities for file management (super_json, super_csv, super_copy, super_open, clean_path) ├── parallel.py # 🔀 Utility functions for parallel processing (multiprocessing, multithreading) ├── print.py # 🖨️ Utility functions for printing messages with different levels of importance └── ...
⭐ Star History#
📖 Module Documentation#
- stouputils package
- Subpackages
- stouputils.applications package
- Subpackages
- stouputils.applications.upscaler package
- Submodules
- stouputils.applications.upscaler.config module
WAIFU2X_NCNN_VULKAN_RELEASESFFMPEG_RELEASESYOUTUBE_BITRATE_RECOMMENDATIONSConfigConfig.JPG_QUALITYConfig.VIDEO_FINAL_BITRATEConfig.FFMPEG_EXECUTABLEConfig.FFMPEG_ARGSConfig.FFPROBE_EXECUTABLEConfig.FFMPEG_CHECK_HELP_TEXTConfig.UPSCALER_EXECUTABLEConfig.UPSCALER_ARGSConfig.UPSCALER_EXECUTABLE_HELP_TEXTConfig.SLIGHTLY_FASTER_MODEConfig.upscaler_executable_checkedConfig.ffmpeg_executable_checked
- stouputils.applications.upscaler.image module
- stouputils.applications.upscaler.video module
- stouputils.applications.upscaler.config module
- Submodules
- stouputils.applications.upscaler package
- Submodules
- Subpackages
- stouputils.continuous_delivery package
- stouputils.data_science namespace
- Subpackages
- stouputils.data_science.config namespace
- Submodules
- stouputils.data_science.config.get module
- stouputils.data_science.config.set module
DataScienceConfigDataScienceConfig.SEEDDataScienceConfig.ERROR_LOGDataScienceConfig.AUGMENTED_FILE_SUFFIXDataScienceConfig.AUGMENTED_DIRECTORY_PREFIXDataScienceConfig.PREPROCESSED_DIRECTORY_SUFFIXDataScienceConfig.ROOTDataScienceConfig.MLFLOW_FOLDERDataScienceConfig.MLFLOW_URIDataScienceConfig.DATA_FOLDERDataScienceConfig.TEMP_FOLDERDataScienceConfig.LOGS_FOLDERDataScienceConfig.TENSORBOARD_FOLDERDataScienceConfig.TEST_SIZEDataScienceConfig.VALIDATION_SIZEDataScienceConfig.SAVE_MODELDataScienceConfig.DO_SALIENCY_AND_GRADCAMDataScienceConfig.DO_LEARNING_RATE_FINDERDataScienceConfig.DO_UNFREEZE_FINDERDataScienceConfig.DO_FIT_IN_SUBPROCESSDataScienceConfig.MIXED_PRECISION_POLICYDataScienceConfig.TENSORFLOW_DEVICEDataScienceConfig.update_root()
- Submodules
- stouputils.data_science.data_processing namespace
- Subpackages
- stouputils.data_science.data_processing.image package
- Submodules
- stouputils.data_science.data_processing.image.auto_contrast module
- stouputils.data_science.data_processing.image.axis_flip module
- stouputils.data_science.data_processing.image.bias_field_correction module
- stouputils.data_science.data_processing.image.binary_threshold module
- stouputils.data_science.data_processing.image.blur module
- stouputils.data_science.data_processing.image.brightness module
- stouputils.data_science.data_processing.image.canny module
- stouputils.data_science.data_processing.image.clahe module
- stouputils.data_science.data_processing.image.common module
- stouputils.data_science.data_processing.image.contrast module
- stouputils.data_science.data_processing.image.curvature_flow_filter module
- stouputils.data_science.data_processing.image.denoise module
- stouputils.data_science.data_processing.image.histogram_equalization module
- stouputils.data_science.data_processing.image.invert module
- stouputils.data_science.data_processing.image.laplacian module
- stouputils.data_science.data_processing.image.median_blur module
- stouputils.data_science.data_processing.image.noise module
- stouputils.data_science.data_processing.image.normalize module
- stouputils.data_science.data_processing.image.random_erase module
- stouputils.data_science.data_processing.image.resize module
- stouputils.data_science.data_processing.image.rotation module
- stouputils.data_science.data_processing.image.salt_pepper module
- stouputils.data_science.data_processing.image.sharpening module
- stouputils.data_science.data_processing.image.shearing module
- stouputils.data_science.data_processing.image.threshold module
- stouputils.data_science.data_processing.image.translation module
- stouputils.data_science.data_processing.image.zoom module
- Submodules
- stouputils.data_science.data_processing.image package
- Submodules
- stouputils.data_science.data_processing.image_augmentation module
- stouputils.data_science.data_processing.image_preprocess module
- stouputils.data_science.data_processing.prosthesis_detection module
- stouputils.data_science.data_processing.technique module
ProcessingTechniqueProcessingTechnique.nameProcessingTechnique.rangesProcessingTechnique.probabilityProcessingTechnique.customProcessingTechnique.deterministic()ProcessingTechnique.apply()ProcessingTechnique._asdict()ProcessingTechnique._field_defaultsProcessingTechnique._fieldsProcessingTechnique._make()ProcessingTechnique._replace()
RecommendedProcessingTechniqueRecommendedProcessingTechnique.ROTATIONRecommendedProcessingTechnique.TRANSLATIONRecommendedProcessingTechnique.SHEARINGRecommendedProcessingTechnique.AXIS_FLIPRecommendedProcessingTechnique.NOISERecommendedProcessingTechnique.SALT_PEPPERRecommendedProcessingTechnique.SHARPENINGRecommendedProcessingTechnique.CONTRASTRecommendedProcessingTechnique.ZOOMRecommendedProcessingTechnique.BRIGHTNESSRecommendedProcessingTechnique.BLURRecommendedProcessingTechnique.RANDOM_ERASERecommendedProcessingTechnique.CLAHERecommendedProcessingTechnique.BINARY_THRESHOLDRecommendedProcessingTechnique.THRESHOLDRecommendedProcessingTechnique.CANNYRecommendedProcessingTechnique.LAPLACIANRecommendedProcessingTechnique.AUTO_CONTRASTRecommendedProcessingTechnique.CURVATURE_FLOW_FILTERRecommendedProcessingTechnique.BIAS_FIELD_CORRECTIONRecommendedProcessingTechnique.NORMALIZERecommendedProcessingTechnique.MEDIAN_BLURRecommendedProcessingTechnique.NLM_DENOISERecommendedProcessingTechnique.BILATERAL_DENOISERecommendedProcessingTechnique.TV_DENOISERecommendedProcessingTechnique.WAVELET_DENOISERecommendedProcessingTechnique.ADAPTIVE_DENOISERecommendedProcessingTechnique.INVERT
- Subpackages
- stouputils.data_science.dataset package
- Submodules
- stouputils.data_science.dataset.dataset module
DEFAULT_IMAGE_KWARGSDatasetDataset._training_dataDataset._val_dataDataset._test_dataDataset.num_classesDataset.nameDataset.loading_typeDataset.grouping_strategyDataset.labelsDataset.class_distributionDataset.original_datasetDataset._get_num_classes()Dataset._update_class_distribution()Dataset.exclude_augmented_images_from_val_test()Dataset.get_experiment_name()
- stouputils.data_science.dataset.dataset_loader module
- stouputils.data_science.dataset.grouping_strategy module
- stouputils.data_science.dataset.image_loader module
- stouputils.data_science.dataset.xy_tuple module
XyTupleXyTuple._XXyTuple._yXyTuple.filepathsXyTuple.augmented_filesXyTuple.n_samplesXyTuple.is_empty()XyTuple.update_augmented_files()XyTuple.group_by_original()XyTuple.get_indices_from_originals()XyTuple.create_subset()XyTuple.remove_augmented_files()XyTuple.split()XyTuple.kfold_split()XyTuple.ungrouped_array()XyTuple.empty()
- stouputils.data_science.dataset.dataset module
- Submodules
- stouputils.data_science.models namespace
- Subpackages
- stouputils.data_science.models.keras namespace
- Submodules
- stouputils.data_science.models.keras.all module
- stouputils.data_science.models.keras.convnext module
- stouputils.data_science.models.keras.densenet module
- stouputils.data_science.models.keras.efficientnet module
- stouputils.data_science.models.keras.mobilenet module
- stouputils.data_science.models.keras.resnet module
- stouputils.data_science.models.keras.squeezenet module
- stouputils.data_science.models.keras.vgg module
- stouputils.data_science.models.keras.xception module
- Submodules
- stouputils.data_science.models.keras_utils namespace
- stouputils.data_science.models.keras namespace
- Submodules
- stouputils.data_science.models.abstract_model module
AbstractModelAbstractModel.routine_full()AbstractModel.class_load()AbstractModel.class_train()AbstractModel.class_predict()AbstractModel.class_evaluate()AbstractModel._fit()AbstractModel._get_callbacks()AbstractModel._get_metrics()AbstractModel._get_optimizer()AbstractModel._get_loss()AbstractModel._get_base_model()AbstractModel._get_architectures()AbstractModel._find_best_learning_rate()AbstractModel._train_fold()AbstractModel._log_final_model()AbstractModel._find_best_learning_rate_subprocess()AbstractModel._find_best_unfreeze_percentage_subprocess()AbstractModel._train_subprocess()
- stouputils.data_science.models.all module
- stouputils.data_science.models.base_keras module
BaseKerasBaseKeras.class_load()BaseKeras._fit()BaseKeras._get_architectures()BaseKeras._get_callbacks()BaseKeras._get_metrics()BaseKeras._get_optimizer()BaseKeras._get_loss()BaseKeras._find_best_learning_rate_subprocess()BaseKeras._find_best_unfreeze_percentage_subprocess()BaseKeras._train_subprocess()BaseKeras.class_predict()BaseKeras._log_final_model()BaseKeras.class_evaluate()
- stouputils.data_science.models.model_interface module
ModelInterfaceModelInterface.final_modelModelInterface.model_nameModelInterface.kfoldModelInterface.transfer_learningModelInterface.is_trainedModelInterface.num_classesModelInterface.override_paramsModelInterface.run_nameModelInterface.historyModelInterface.evaluation_resultsModelInterface.additional_training_dataModelInterface.batch_sizeModelInterface.epochsModelInterface.class_weightModelInterface.unfreeze_percentageModelInterface.fine_tune_last_layersModelInterface.beta_1ModelInterface.beta_2ModelInterface.early_stop_patienceModelInterface.model_checkpoint_delayModelInterface.learning_rateModelInterface.reduce_lr_patienceModelInterface.min_deltaModelInterface.min_lrModelInterface.factorModelInterface.warmup_epochsModelInterface.initial_warmup_lrModelInterface.lr_finder_min_lrModelInterface.lr_finder_max_lrModelInterface.lr_finder_epochsModelInterface.lr_finder_update_per_epochModelInterface.lr_finder_update_intervalModelInterface.unfreeze_finder_epochsModelInterface.unfreeze_finder_update_per_epochModelInterface.unfreeze_finder_update_intervalModelInterface.total_layersModelInterface.class_load()ModelInterface.train()ModelInterface.predict()ModelInterface.evaluate()ModelInterface.routine_full()ModelInterface._routine()ModelInterface._get_transfer_learning_weights()ModelInterface._get_total_layers()ModelInterface._set_parameters()ModelInterface._set_class_weight()ModelInterface._log_parameters()ModelInterface._get_fold_split()ModelInterface._train_final_model()ModelInterface._train_each_fold()ModelInterface.class_train()ModelInterface._log_metrics()ModelInterface.class_evaluate()ModelInterface._find_best_learning_rate()ModelInterface._find_best_unfreeze_percentage()ModelInterface._train_fold()
- stouputils.data_science.models.sandbox module
- stouputils.data_science.models.abstract_model module
- Subpackages
- stouputils.data_science.scripts namespace
- stouputils.data_science.config namespace
- Submodules
- stouputils.data_science.metric_dictionnary module
- stouputils.data_science.metric_utils module
MetricUtilsMetricUtils.metrics()MetricUtils.confusion_matrix()MetricUtils.f_scores()MetricUtils.matthews_correlation()MetricUtils.roc_curve_and_auc()MetricUtils.pr_curve_and_auc()MetricUtils.all_curves()MetricUtils.plot_metric_curves()MetricUtils.plot_every_metric_curves()MetricUtils.find_best_x_and_plot()
- stouputils.data_science.mlflow_utils module
- stouputils.data_science.range_tuple module
- stouputils.data_science.utils module
- Subpackages
- stouputils.installer package
- stouputils.applications package
- Submodules
- stouputils.__main__ module
- stouputils._deprecated module
- stouputils.all_doctests module
- stouputils.archive module
- stouputils.backup module
- stouputils.collections module
- stouputils.ctx module
- stouputils.decorators module
- stouputils.image module
- stouputils.io module
- stouputils.parallel module
- stouputils.print module
- Subpackages