Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

New Results (with child comment count)

...

Old Results (without child comment count)

...

With the new requirements in Discussion APIs; we have introduced an attribute "child_count" in all Response/Comment endpoints. The platform APIs call forum APIs; hence a corresponding change is made in Forum application too. We have opted to cache comment's child_count as part of DB object. In order to keep child_count field value in sync with the actual number of comment children, we have re-evaluated its value on comment get, create and delete end points; however, comment list endpoint returns cached value to keep good performance stats (except for any existing data for which we re-evaluate child_count and cache it then).

We have gathered and compared two sets of load test results. The former results (i.e. With Child Comment Count) are run on the latest changes and the later are run when we had no "child_count" in question.

New Relic Dashboard: https://rpm.newrelic.com/accounts/88178/custom_dashboards/pages/9377

 

= 962805005002305101902503404003806507502903705502602804306307504409101800240360660200230230 = 96400510660660190370310430410690750360520610200270400520670900470610760240370400210230230 = 57658003700890012000270170047005704000770035008300110004500110001200031008800530011000160005300100001500023005900870039004400

With Child Comment Count

Without Child Comment Count

No. of clients = 48
req/s = 3.80
Methodsmedian response time95%99%

DELETE_comment

290

270

4904104902500

DELETE_thread

180

190

11002401100260

GET_comment_list

190160320270340

GET_thread

230340370370470

GET_thread_list

410440740910840

PATCH_comment

2803103804503802500

PATCH_thread

150210700350700420

POST_comment_comment

4304205705805702800

POST_comment_response

560360160053016002800

POST_thread

24026010003901000440

auto_auth

220210220230220230
No. of clients = 48
req/s = 3.70
Methodsmedian response time95%99%

DELETE_comment

38027048016005101700

DELETE_thread

190250280260330

GET_comment_list

190160250260330300

GET_thread

230300400420

GET_thread_list

410400680690730770

PATCH_comment

3103505108606601900

PATCH_thread

190210260310310440

POST_comment_comment

4904006105407661800

POST_comment_response

4603706005806601900

POST_thread

240260380390440430

auto_auth

270200280200280200


No. of clients
 = 68
req/s = 5.30
Methodsmedian response time95%99%
DELETE_comment

270

3000
3200
DELETE_thread180
240
260
GET_comment_list
160
270
320
GET_thread230300
370
GET_thread_list
450
760
820
PATCH_comment
300
470
3200
PATCH_thread200
330
420
POST_comment_comment
410
530
3400
POST_comment_response
360
530
3400
POST_thread
260
400
460
auto_auth
210
210
210


No. of clients
 = 68
req/s = 5.60
Methodsmedian response time95%99%
DELETE_comment
270
1700
1800
DELETE_thread190240260
GET_comment_list
160260
350
GET_thread230
300
390
GET_thread_list
400
710
780
PATCH_comment
310
510
1800
PATCH_thread
210
300
440
POST_comment_comment
410
1800
1900
POST_comment_response
370
530
1900
POST_thread
260
390
440
auto_auth
280
310
310


No. of clients
= 144
 = 96
req/s = 7.70
POST
Methodsmedian response time95%99%

DELETE_comment

2902804009704002800

DELETE_thread

190270240270370

GET_comment_list

190160260270350

GET_thread

230310380390

GET_thread_list

460450680760950830

PATCH_comment

32033055015007002900

PATCH_thread

190210250330290450

POST_comment_comment

4209905709903000

POST_comment_response

200370110060038002900

POST_thread

260360450

auto_auth

210210210


No. of clients = 96
req/s = 7.30
Methodsmedian response time95%99%

DELETE_comment

2703601800

DELETE_thread

190240300

GET_comment_list

160260360

GET_thread

240300400

GET_thread_list

410720790

PATCH_comment

3104401800

PATCH_thread

210300420

POST_comment_comment

4104801900

POST_comment_response

3705101900

POST_thread

260330420

auto_auth

210250220250220


No. of clients = 144
req/s = 10.90
Methodsmedian response time95%99%

DELETE_comment

41028059031007103300

DELETE_thread

190250300570

GET_comment_list

190160270290360370

GET_thread

250240340430450

GET_thread_list

430490710820770940

PATCH_comment

3803206005506903300

PATCH_thread

200210270310350420

POST_comment_comment

5504207507808903700

POST_comment_response

5003706805807503500

POST_thread

240260330380410460

auto_auth

200130021014002101400


No. of clients
= 192
 = 144
req/s = 11.20
Methodsmedian response time95%99%

DELETE_comment

30028055016007702100

DELETE_thread

19011002602400340

GET_comment_list

180160250270360

GET_thread

240330500460

GET_thread_list

47042034007404000810

PATCH_comment

310330900180012002100

PATCH_thread

210330450

POST_comment_comment

4207102200

POST_comment_response

380120021003400

POST_thread

260410450

auto_auth

210220220


No. of clients = 192
req/s = 14.40
Methodsmedian response time95%99%

DELETE_comment

2904103600

DELETE_thread

200260340

GET_comment_list

170290390

GET_thread

250370490

GET_thread_list

5008401000

PATCH_comment

3305103100

PATCH_thread

220350440

POST_comment_comment

460430810290010003700

POST_comment_response

41038016006203500

POST_thread

240270800370970440

auto_auth

230026024002602400260


No. of clients = 192
req/s = 16.60
Methodsmedian response time95%99%

DELETE_comment

45028070059018002200

DELETE_thread

190260310320

GET_comment_list

2001703202801300370

GET_thread

2802504403601000500

GET_thread_list

460440750760990850

PATCH_comment

41032072053012002300

PATCH_thread

2103101400450

POST_comment_comment

60043087068020002500

POST_comment_response

55038082056017002300

POST_thread

2502703904001200450

auto_auth

220190220230220230


No. of clients = 240
req/s = 17.90
Methodsmedian response time95%99%

DELETE_comment

3302907905607904300

DELETE_thread

190320300780530

GET_comment_list

190170260350380510

GET_thread

240260340450450710

GET_thread_list

46063070012007901800

PATCH_comment

2903404507006003700

PATCH_thread

200220640350750470

POST_comment_comment

470450690160010004400

POST_comment_response

4003907006809304500

POST_thread

240270380400390490

auto_auth

210230220230220230


No. of clients = 240
req/s = 19.50
Methodsmedian response time95%99%

DELETE_comment

560300990210015002800

DELETE_thread

200300280420340

GET_comment_list

210170350300540410

GET_thread

310260570420880590

GET_thread_list

5104808101000970

PATCH_comment

480340100071014002600

PATCH_thread

210220300340410500

POST_comment_comment

7204501100220015002700

POST_comment_response

650390110082017002700

POST_thread

260270390410540490

auto_auth

260200380220380220


No. of clients = 288
req/s = 22.80
Methodsmedian response time95%99%

DELETE_comment

3203104408105503700

DELETE_thread

190200280290290450

GET_comment_list

190180270340370450

GET_thread

250280370470500640

GET_thread_list

45066074012008301500

PATCH_comment

3303505006305503800

PATCH_thread

2002203303401000450

POST_comment_comment

4606208506303900

POST_comment_response

4104006106506803900

POST_thread

240270330410410490

auto_auth

220220250220250


No. of clients = 288
req/s = 22.40
Methodsmedian response time95%99%

DELETE_comment

9403002900210045002800

DELETE_thread

2202005002801200520

GET_comment_list

2501806203201100450

GET_thread

49027017004502500640

GET_thread_list

53059091012001800

PATCH_comment

840350270054043002500

PATCH_thread

230540350879460

POST_comment_comment

12004603500220050002800

POST_comment_response

1100410330067047002800

POST_thread

2902806104201100480

auto_auth

200220260260220


No. of clients = 336
req/s = 27.70
Methodsmedian response time95%99%

DELETE_comment

340320650280013004800

DELETE_thread

190210310300470490

GET_comment_list

1902804102107600

GET_thread

2703004205902564880

GET_thread_list

500860800210022503700

PATCH_comment

32036075090018604600

PATCH_thread

210240350390758490

POST_comment_comment

50049083085012074500

OST_comment_response

45042084093016824700

POST_thread

250280400430934590

auto_auth

230250260263
N/A; server reached max capacity
280280


No. of clients
= 384
 = 336
req/s = 26.30
POST
Methodsmedian response time95%99%

DELETE_comment

4303101500230023003400

DELETE_thread

190210800290850420

GET_comment_list

200190310360470510

GET_thread

280290480550920810

GET_thread_list

600520110014002100

PATCH_comment

3601200110025003200

PATCH_thread

210240430400700560

POST_comment_comment

530470150025004000

OST_comment_response

500420170075022003800

POST_thread

2602806504201200510

auto_auth

270210290290
N/A; server reached max capacity
240240


No. of clients
= 432
 = 384
req/s = 16.30 (reached server capacity)
Methodsmedian response time95%99%

DELETE_comment

4306000360013000380015000

DELETE_thread

2204600170010000210014000

GET_comment_list

2003200330870047011000

GET_thread

30034005608800190012000

GET_thread_list

5507100220012000320014000

PATCH_comment

4204300330011000460015000

PATCH_thread

2503700130010000200013000

POST_comment_comment

5905600440013000620019000

POST_comment_response

5205400320012000410015000

POST_thread

270340014008800190012000

auto_auth

690260016001600
N/A; server reached max capacity
35003500


No. of clients
= 480
 = 384
req/s = 31.70
Methodsmedian response time95%99%
DELETE_comment7603406300110076004500
DELETE_thread22021028003504300680
GET_comment_list2102003704301000670
GET_thread32033078074034001100
GET_thread_list7207703500180051002700
PATCH_comment510380490086063004200
PATCH_thread27025035004003900570
POST_comment_comment10005006100130074004600
POST_comment_response740440530091064004100
POST_thread29026004503300640
auto_auth160021022002200
N/A; server reached max capacity
230230


No. of clients
= 528
 = 480
req/s = 5.00 (reached server capacity)
Methodsmedian response time95%99%

DELETE_comment

160012000780026000910040000

DELETE_thread

120010000480026000510042000

GET_comment_list

230840051022000220030000

GET_thread

3809400150023000480033000

GET_thread_list

140012000490023000580030000

PATCH_comment

150011000710025000820032000

PATCH_thread

120010000530023000580030000

POST_comment_comment

2200120007300240001000030000

POST_comment_response

280011000770025000910032000

POST_thread

8909000400021000480030000

auto_auth

2700440040004000
N/A; server reached max capacity
81008200


No. of clients
 = 480
req/s = 20.40 (reached server capacity)
Methodsmedian response time95%99%
DELETE_comment
59001200015000
DELETE_thread
5400
10000
13000
GET_comment_list
4600
9700
12000
GET_thread
5000
9900
14000
GET_thread_list
8600
13000
15000
PATCH_comment
5800
12000
14000
PATCH_thread
5100
1000013000
POST_comment_comment
6200
12000
15000
POST_comment_response
5700
11000
14000
POST_thread
4700
9300
12000
auto_auth
3300
5400
4500N/A; server reached max capacity

 

New Relic Graphs:

For details: https://rpm.newrelic.com/accounts/88178/custom_dashboards/86/pages/119501?agent=6074037

GraphNew ResultsOld Results
Response GraphImage RemovedImage Removed
PercentileImage RemovedImage Removed
ThroughputImage RemovedImage Removed

 

...

5500


Detailed Results:

With Child Count:

View file
namewith-child_count.rtf
height250

Without Child Count:

View file
namewithout-child_count.rtf
height250