Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleRerun of mixed courses test after first index was added

This is before adding the "asc" index and after adding the "last_activity_at" index. The major difference is the lack of spikes, consistent RPM, better response times especially for the large course and no 500s.

This test was run for 3 minutes with a small course vs large course on a 20:1 ratio. The large course used is BerkeleyX/ColWri2.2x/1T2014 (~25,000 threads, 30,000 comments) , while the small course is SMES/ASLCx/1T2015 (1700 Threads, 3047 comments). 

Namereqs#failsAvgMinMaxMedianreq/s95%
LargeGET_comment_list460(0.00%)44320711553700840
 GET_thread24040(0.00%)22516812752100.7290
 GET_thread_list12960(0.00%)48918111044800.6830
 PATCH_comment450(0.00%)49022120604500780
 PATCH_thread530(0.00%)48917419124100.11100
SmallGET_comment_list8770(0.00%)21115410722000.3300
 GET_thread557102(0.00%)198141156219028.2260
 GET_thread_list296940(0.00%)449147391943013.2810
 PATCH_comment8754(0.46%)34018415843200.2560
 PATCH_thread10389(0.86%)25915010552400.5420

Checkpoint:

 

...

  At this point, it was discovered that the locust script was not correctly sending requests as intended. Rather than waiting after certain tasks, it would immediately send a new one. The RPS remains the same with the appropriate locust users which now correlate with the RPS. 

Page size vs. Response time:

    In a new test, it was found that SMES/ASLCx/1T2015 (1700 Threads, 3047 comments) was slowing down over time. To identify what was happening, a new course was seeded which we will call DAPI (1000 Threads, 500 comments). In the analysis of the forums, we saw that the median body size was 250 characters. Our PATCH operations can be 4, 250, 1000, 5000, or 10000 characters. This test was run over 10 hours. The decrease in response time needed to be addressed.

Expand

 

 

Image Added

Namereqs#failsAvgMinMaxMedianreq/s95%
GETGET_comment_list157930(0.00%)22016231162000.2340
GETGET_thread9550971(0.00%)214-8450920023.8290
GETGET_thread_list5109210(0.00%)44515559542011.6810
PATCHPATCH_comment157920(0.00%)33718738513200.2490
PATCHPATCH_thread17333164(0.94%)27316130192500.5400


 

    

     

NEXT STEPS:

Run with new index.

...