You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+30
Original file line number
Diff line number
Diff line change
@@ -42,4 +42,34 @@ The function receive only the data and return the modified data
42
42
fit_transform: performs both fit and transforms the same data and return the transformed data.
43
43
Receives the same parameters as fit and return results as transform.
44
44
45
+
46
+
deep_learning file contains methods to work with the transformer.
47
+
The main method deep_learn_csv receives csv path and a transformer and applies the transformer on the data, Then it transforms the data and saves it under a new csv file (path received as a parameter)
48
+
If the csv file is complicated it is possible to remove column (which will be added later in the printout) by providing the list of column names in remove_columns parameter. The same goes for ids column (ids parameter) and class column (responses parameter) if they exist.
49
+
50
+
51
+
The __init__ file contains the main program of the code.
52
+
The file contains 4 lists:
53
+
csv_sources : sources of the csv on which to operate.
54
+
classes : list of classes column in for each datasource (correlated to the csv_resource list)
55
+
reduction_counts : list of number of desired feature for each dataset (correlated to the csv_resource list)
56
+
params : list of parameters to use. the parameters are defined above it.
57
+
58
+
The main program goes over all csv resources and for each, it performs tranformation with each of the parameters.
59
+
The result will be |csv_resources|*|params| csv files which will be output to the same directory where the resource is with the extension _dl# to it (# according to the parameter order in list)
60
+
61
+
62
+
45
63
Instruction for contributing to the code:
64
+
65
+
It is possible to contribute different functions:
66
+
67
+
Optimizer_function file: should contain different types of optimizer for the deep_transformer, currently it present only one optimizer which is described in deepsign article.
68
+
69
+
reduction_function: contains different reduction function.
70
+
A reduction function is a function that receives adataset x, and returns a number to which the transformer should compress the feature count.
71
+
Mostly, the function looks at the length of the data (number of features is visible bt using len(x[0]) ) and then deciding the new count.
72
+
For examle half_reduction_function receives data with l parameters and returns the number l/2
73
+
Note that the number must be smaller then the number of current features, or else the algorithm will never stop.
0 commit comments