The Official GoKickOff Online Community Forums

General Category => Suggestions/Bugs => Topic started by: Brian Clough on April 01, 2012, 02:20:20 AM

Title: [BUG] Training form probabilities
Post by: Brian Clough on April 01, 2012, 02:20:20 AM
I have been keeping careful track of training results for over a week now, and there seems to be a bug in the training system because my observed frequencies of training form results on my team differ significantly from those posted on the training page.

To remind everyone, current system purportedly works this way
    Light : The chance of getting bad and good training result are 50% and 0% respectively.
    Medium : The chance of getting bad and good training result are 5% and 3% respectively.
    Heavy : The chance of getting bad and good training result are 0% and 12% respectively.
    Very Heavy : The chance of getting bad and good training result are 0% and 30% respectively.

My results (updated daily):
Setting               Number             Bad                   Okay                  Good
Light                     40                  19 (47.5%)         21 (52.5%)            0 (--%)
Medium                247                 21 (8.5%)        226  (91.5%)       0 (0%)
Heavy                  113                   0  (0%)             107  (94.7%)         6 (5.3%)
Very Heavy            22                    0  (--%)             16 (--%)               6 (--%)
emboldened figures differ significantly from those above
Flipping a coin 5 or 10 times won't necessarily result in 50% for each side. But flipping a coin 100 or 1000 times should produce results that are increasingly close to actual values.

I will continue to update my results, and encourage others to share theirs.
Observed probabilities will be posted only after I have around 30 "samples" for statistical power.

so far I can conclude that there are some significant differences in results above from those figures outlined on training page, which constitutes evidence of a bug in the system...more conclusions to come as adequate data becomes available

Edit: At current rates, the probability of my 201 training results at medium setting without a single good form result is 0.97^224 = 0.1%, a very unlikely outcome excluding a bug
Title: Re: [BUG] Training form probabilities
Post by: Mr.Es on April 01, 2012, 06:05:13 PM
I feel like you too but not sure that is a bug .
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on April 01, 2012, 06:53:58 PM
yeah, continue updating. i should post myself in gko record post-no good training form for a month
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on April 02, 2012, 03:59:32 AM
I feel like you too but not sure that is a bug .

It is not a feeling...my conclusions are based on binomial statistical analysis using a significance (?) level of 95%. This means that for each highlighted result, there is at least a 95% chance that highlighted differences between my observed results and the true probabilities are not attributable to chance. With more data this may rise to 99% for both medium and hard training settings (already above 99% for good form result from medium setting).

Thank goodness my college education didn't go to waste *lol*  :P
Title: Re: [BUG] Training form probabilities
Post by: SoLid_frOg on April 02, 2012, 04:15:51 AM
Maybe you should show it all ie. null hypothesis, alternative hypothesis, t-statistic, t-critical etc. lol

But i think the results skew to the "bad" too.
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on April 03, 2012, 04:15:46 AM
Maybe you should show it all ie. null hypothesis, alternative hypothesis, t-statistic, t-critical etc. lol

But i think the results skew to the "bad" too.

pmsl
:))
I just might if admin doesn't address this pretty soon...
???

Meanwhile, if anyone has ever gotten good training form result from medium setting I'd like to know...I know at least two of us haven't yet
Title: Re: [BUG] Training form probabilities
Post by: panchchou on April 03, 2012, 08:21:23 AM
I checked my training report everyday. and never found the "good" report.
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on April 04, 2012, 05:16:35 AM
this is ridiculous, today 4/22 players with medium workload had bad form. thats almost 1/5
Title: Re: [BUG] Training form probabilities
Post by: SoLid_frOg on April 04, 2012, 05:43:59 AM
I have a bad feeling about this.

And i'm not a jedi lol.
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on April 04, 2012, 06:06:51 AM
(http://c810422.r22.cf2.rackcdn.com/wp-content/uploads/2010/01/symantec-endpoint-security-bug.jpg)
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on April 06, 2012, 01:21:09 PM
it looks like admin is ignoring
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on April 11, 2012, 06:52:40 PM
you dont have any problems in saving new youth trainings?i am not allowed to save it
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on April 11, 2012, 11:34:31 PM
Whether admin wants to address this or not, it is really looking like the ACTUAL probabilities are something very close to this:
  Light : The chance of getting bad and good training result are 50% and 0% respectively.
  Medium : The chance of getting bad and good training result are 8% and 0% respectively.
  Heavy : The chance of getting bad and good training result are 0% and 5% respectively.
  Very Heavy : The chance of getting bad and good training result are 0% and 30% respectively.
 :-[
Title: Re: [BUG] Training form probabilities
Post by: Kr10s on April 12, 2012, 12:15:42 AM
So... i wasn't crazy after all  :P
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on April 12, 2012, 06:18:18 PM
you dont have any problems in saving new youth trainings?i am not allowed to save it
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on April 19, 2012, 05:02:41 AM
Admin, if you can't or don't want to fix this bug (anytime soon) then at least change the text on the training window to reflect accurate values of training form probabilities. No one in GKO has ever gotten good form with medium training, so this really should be declared! If you are working on it (or plan to soon), please let us know!
???
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on May 07, 2012, 04:20:16 AM
6 bad training forms with medium workload, anyone had more? :-) no good training for lots of months
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on May 07, 2012, 09:54:20 AM
admin has posted ban list but no response here so far
Title: Re: [BUG] Training form probabilities
Post by: paul_gazza on May 07, 2012, 10:02:30 AM
yesterday 6 bad, now 5 bad... GOOD....???
Title: Re: [BUG] Training form probabilities
Post by: MathewsPateras on May 08, 2012, 12:53:14 AM
Yesterday 5 bad, today 8 bad....GOOD 0!! ???
All with medium trainning
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on May 08, 2012, 04:48:42 AM
@buncombe: Do you have updates stats of training results for this period. Im beginning to sense that its actually even worse than the presentet data suggests.

I got tired of doing it after admin refused to even address this or say they are working on it. Basically, these are my conclusions:

Whether admin wants to address this or not, it is really looking like the ACTUAL probabilities are something very close to this:
  Light : The chance of getting bad and good training result are 50% and 0% respectively.
  Medium : The chance of getting bad and good training result are 8% and 0% respectively.
  Heavy : The chance of getting bad and good training result are 0% and 5% respectively.
  Very Heavy : The chance of getting bad and good training result are 0% and 30% respectively.
 :-[
...and I stick by these.
While it may seem worse when 5 or 8 bad form results come up. On average, one should expect 2 bad form results out of 24 on medium training. With these odds, the probability of getting 8 bad form is not that extraordinarily unlucky...
Title: Re: [BUG] Training form probabilities
Post by: admin on May 08, 2012, 03:20:31 PM
This feature has been tested and it works properly.
The small amount of data that you guys collected can't be used as a statistical data.

GKO
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on May 08, 2012, 03:59:40 PM
This feature has been tested and it works properly.
The small amount of data that you guys collected can't be used as a statistical data.

GKO

so not getting good training form for 2 months is normal?for god sake, nobody has posted a fact about getting good training form and you say its normal?cmon, thats not even funny
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on May 08, 2012, 10:26:20 PM
This feature has been tested and it works properly.
The small amount of data that you guys collected can't be used as a statistical data.

GKO
Really? Let's find out!
I hypothesize that observed good form results from medium training are statistically different from those reported.
 
Test 1: z-test using normal curve
A z-proportions test was used to to test whether significantly fewer "good" form results from medium training intensity were observed than are reported (3%). Of the 247 observations, 0 (0%) were good and 247 (100%) were not. This difference is statistically significant (z = -2.7639) at ? = 0.05, indicating that fewer good form results were observed than would be expected by chance. Thus the probability that the actual probability of getting good form result from medium training is less than the reported 3% is > 99.71%.

Test 2: chi-square test
A chi-square test was also used to test whether significantly fewer "good" form results from medium training intensity were observed than are reported (3%). Again the difference is statistically significant (X2 = 7.6392, df=1) yielding the precise p-value of 0.006092.

n = 247 for both tests.

Thus we should reject the null hypothesis (there is no difference between observed and reported probabilities) in favor of the alternative (stated above). These results provide very strong evidence that there is at least one bug in this feature.

The z-test is easily done using a calculator and normal probability table.
The chi square test was done using two separate programs found online here (http://math.hws.edu/javamath/ryan/ChiSquare.html) and  here (http://www.missouristate.edu/assets/rstats/Chi_square_calculator.xls) so anyone can run the test for themself.
However, as Gabriellis pointed out, the fact that there have not been any reported good form results from medium training really speak for themself!
 >:(

If someone else can record and post 50-100 results from hard training we can test whether there is also a bug in good form results from hard training. Due to the relatively low number of observations I have made there, the resulting p-value is a little bit high to draw conclusions with real confidence (p <0.08 based on the data in my original post), but with some more, much stronger evidence can be reported. I just don't have the time tbf.
 ;)
Title: Re: [BUG] Training form probabilities
Post by: Ruta on May 09, 2012, 05:56:57 AM
This feature has been tested and it works properly.
The small amount of data that you guys collected can't be used as a statistical data.

GKO

I never have good form from medium training either. I have more then 15 players in that regime every day!
So your test must be wrong :( Or you has been tested only about bad form which woks properly.
Title: Re: [BUG] Training form probabilities
Post by: admin on May 09, 2012, 10:20:25 AM
After we sent this issue to the development team to recheck. There was an error that will result in 0% good training from Medium workload, as you mentioned.

We apologize for making two mistakes.
1. Our mistake in the test of this feature in the first place.
2. As we said "The small amount of data that you guys collected can't be used as a statistical data" . In fact, the hypothesis test has shown very strong evidence to reject the null hypothesis (good training < 3% ?), as buncombe has mentioned.

However, we've fixed this bug. Training results now work correctly.
Thank you very much for giving the information to us.
Title: Re: [BUG] Training form probabilities
Post by: Ruta on May 09, 2012, 10:42:07 AM
Ok, thanks. It is good to see that our requests had some result.
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on May 09, 2012, 03:13:33 PM
After we issue this topic to the development team to check it again. There was an error that will result in 0% good training from Medium workload, as you said.

We apologize for making two mistakes.
1. Our mistake in the test of this feature in the first time.
2. As we said "The small amount of data that you guys collected can't be used as a statistical data" . In fact, the hypothesis test show very strong evidence to reject the null hypothesis (good training < 3% ?), as buncombe was mentioned.

However, we've fixed. Training results now work correctly.
Thank you very much. For anyone who give information to us.

Thank you for acknowledging!
 8)  8)  8)
Title: Re: [BUG] Training form probabilities
Post by: gabrielis on May 09, 2012, 03:19:40 PM
told ya -.-
Title: Re: [BUG] Training form probabilities
Post by: Mr.Es on May 10, 2012, 12:45:12 AM
Today , 1 player has good training form with medium workload .
 :)
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on August 17, 2012, 06:11:38 PM
Does anyone else feel as if the old (bugged) system was somehow reinstated with the new season?

Since the start of the new season, training form has dipped significantly for me...my most recent report has 0 good form results from 14 hard and 21 medium workloads...at most I am only getting one or two good results per day, though last season I was getting 5+ from a similar training program. This could just be a probabilistic anomaly, since I haven't been keeping a close eye on it, so I wanted to see if anyone else has noticed a similar trend in their training form results since the start of season 6

 :-\
Title: Re: [BUG] Training form probabilities
Post by: Igecot on August 17, 2012, 06:59:11 PM
I don't know why you get bad results, but i also think something is not right with the training!! I have all my players on medium, and one player is getting bad training 3 days in a row(he has PR 5), but ok maybe it happens. Also few players get training in other skills, different from what i set them to training! I mean how can player with training Tactical(teamwork, decisions) 3 days in a row to get training Determination, Pace, Agility??
Title: Re: [BUG] Training form probabilities
Post by: Igecot on August 17, 2012, 07:08:27 PM
I forgot to mention that i get Good results, but that is mostly on players who don't progress on training, so the result of the training is 0.01 !! So on medium training i had maybe 4-5 good training for players that have PR 4-5!!!
Title: Re: [BUG] Training form probabilities
Post by: Kr10s on August 17, 2012, 07:40:23 PM
Same here...
I can't say that i didin't get good results on normal trianing, but i've got the feeling that they are less than last season's results.
Title: Re: [BUG] Training form probabilities
Post by: Igecot on August 17, 2012, 10:48:37 PM
There must be something wrong! Also I can see in my players that when i choose specific training for my players , training is little bit weaker (-0.02,3) , and I think i should get normal training as my TC is Good level!!!
Title: Re: [BUG] Training form probabilities
Post by: Kr10s on August 26, 2012, 02:17:41 AM
I've been looking at it since this post came back to life......

I started to track my team's training form since August 17th (when this thread came back to life) and i didn't get a good training form (using medium workload) in a week, anyone else?
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on August 26, 2012, 04:35:25 AM
I have gotten a few good form results, but only from heavy training load, not from medium
 ::)
Title: Re: [BUG] Training form probabilities
Post by: Igecot on August 26, 2012, 09:45:19 AM
I have gotten few good form results with medium training!! But i felt bad that one of my talented players who is 15 y. had 4-5 bad form results!!! Also i know that when training multiple skills, the player can develop in other skills different from what I set, but my FC was training Shooting, and he develop in marking, tackling 2-3 days in a row...Also my DL was training defending, and he develop in pace, teamwork etc..
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on August 30, 2012, 05:30:26 PM
I haven't been keeping an exact tally but I would guess that the issue is with hard training load. I am getting an occasional good form result from medium training but good form results from players on heavy training seems to be far below the 12% probability. I'd guess that it is closer to 3%. I don't have enough players on very hard training load to make any conclusions on it, however.
 ::)
Title: Re: [BUG] Training form probabilities
Post by: Brian Clough on September 05, 2012, 05:05:31 AM
I really don't want to have to compute this all again, but I would bet a 3-month premium membership that at least the hard training form system has a bug. Don't use very hard enough to even guess. But hard training form results are consistently under par.
 :-[
Title: Re: [BUG] Training form probabilities
Post by: Igecot on November 06, 2012, 02:13:44 AM
Strange thing happen to me on today training .... 3 of my players got GOOD form with medium training  8) I couldn't belieuve it ...