NightlyCode.Ai 0.4.11-preview

This is a preview package and is expected to make breaking changes like every other release.

NightlyCode.Ai

With this package you can build and train neuronal nets.

DynamicBinOp

The best working implementation in this package currently is the DynamicBinOp net which features a self growing net which trains by mutating its elements and generating new neurons from time to time.

Usage

The most basic case to use a dynamicbinopnet would be to create one manually.

DynamicBinOpNet net=new(new(["x"], ["y"]))

This would create a net with one input neuron "x" and an output neuron "y". While this is a working neuronal net it doesn't do anything meaningful as there are no connections in it.

To have a working neuronal net you first need to train a configuration.

Training

Training is done by a population which hopefully evolves to contain a working configuration at some point.

Population<DynamicBinOpConfiguration> population = new(100, rng => new(["x"], ["y"], rng));

Then a setup is needed which contains the training samples used to train the configurations.

        EvolutionSetup<DynamicBinOpConfiguration> setup = new() {
                                                                    TrainingSet = [...],
                                                                    Runs = 5000,
                                                                    Threads = 2
};

The TrainingSet property is a collection of test cases which return a deviation value based on a configuration. Usually one would feed a neuronal net with the provided configuration, fill the input values of the net and then compute the results. Then a good return would be the average or summed up deviation of the result values to the expected values.

A good template for a test func for the upper case would be

ConcurrentStack<DynamicBinOpNet> netStack = new();
float Test(DynamicBinOpConfiguration config, float x, float expected) {
    if (!netStack.TryPop(out DynamicBinOpNet net))
        net = new(config);
    else net.Update(config);

    net["x"] = x;
    net.Compute();
    float result = net["y"];
    return Math.Abs(expected - result);
}

When the setup is created with samples the population can be trained with

Tuple<DynamicBinOpConfiguration, double> result=population.Train(setup);

The population returns the best configuration based on the training set after the number of runs are completed or a threshold is reached. This configuration can be used to feed a neuronal net and compute values.