Table Of Contents

mxnet.test_utils.verify_generator

mxnet.test_utils.verify_generator(generator, buckets, probs, nsamples=1000000, nrepeat=5, success_rate=0.25, alpha=0.05)

Verify whether the generator is correct using chi-square testing.

The test is repeated for “nrepeat” times and we check if the success rate is

above the threshold (25% by default).

Parameters:

• generator (function) –

  A function that is assumed to generate i.i.d samples from a specific distribution.

  generator(N) should generate N random samples.

• buckets (list of tuple or list of number) –

  The buckets to run the chi-square the test. Make sure that the buckets cover

  the whole range of the distribution. Also, the buckets must be in ascending order and have no intersection

• probs (list or tuple) – The ground-truth probability of the random value fall in a specific bucket.
• nsamples (int) – The number of samples to generate for the testing
• nrepeat (int) – The times to repeat the test
• success_rate (float) – The desired success rate
• alpha (float) – The desired threshold for type-I error i.e. when a true null hypothesis is rejected

Returns:

cs_ret_l – The p values of the chi-square test.

Return type:

list

arrow_back

Previous

mxnet.test_utils.var_check

arrow_forward

Next

mxnet.util