Skip to content

Commit 87ae4f2

Browse files
committed
Update README.md
1 parent 872e30c commit 87ae4f2

File tree

1 file changed

+30
-0
lines changed

1 file changed

+30
-0
lines changed

Diff for: README.md

+30
Original file line numberDiff line numberDiff line change
@@ -42,4 +42,34 @@ The function receive only the data and return the modified data
4242
fit_transform: performs both fit and transforms the same data and return the transformed data.
4343
Receives the same parameters as fit and return results as transform.
4444

45+
46+
deep_learning file contains methods to work with the transformer.
47+
The main method deep_learn_csv receives csv path and a transformer and applies the transformer on the data, Then it transforms the data and saves it under a new csv file (path received as a parameter)
48+
If the csv file is complicated it is possible to remove column (which will be added later in the printout) by providing the list of column names in remove_columns parameter. The same goes for ids column (ids parameter) and class column (responses parameter) if they exist.
49+
50+
51+
The __init__ file contains the main program of the code.
52+
The file contains 4 lists:
53+
csv_sources : sources of the csv on which to operate.
54+
classes : list of classes column in for each datasource (correlated to the csv_resource list)
55+
reduction_counts : list of number of desired feature for each dataset (correlated to the csv_resource list)
56+
params : list of parameters to use. the parameters are defined above it.
57+
58+
The main program goes over all csv resources and for each, it performs tranformation with each of the parameters.
59+
The result will be |csv_resources|*|params| csv files which will be output to the same directory where the resource is with the extension _dl# to it (# according to the parameter order in list)
60+
61+
62+
4563
Instruction for contributing to the code:
64+
65+
It is possible to contribute different functions:
66+
67+
Optimizer_function file: should contain different types of optimizer for the deep_transformer, currently it present only one optimizer which is described in deepsign article.
68+
69+
reduction_function: contains different reduction function.
70+
A reduction function is a function that receives adataset x, and returns a number to which the transformer should compress the feature count.
71+
Mostly, the function looks at the length of the data (number of features is visible bt using len(x[0]) ) and then deciding the new count.
72+
For examle half_reduction_function receives data with l parameters and returns the number l/2
73+
Note that the number must be smaller then the number of current features, or else the algorithm will never stop.
74+
75+
Enjoy using and contributing to this code.

0 commit comments

Comments
 (0)