[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"summary-63e2ecb9ef81ee97-how-adam-s-variance-normalization-fixes-sgd-s-freq-summary":3,"summaries-facets-categories":109,"summary-related-63e2ecb9ef81ee97-how-adam-s-variance-normalization-fixes-sgd-s-freq-summary":7013},{"id":4,"title":5,"ai":6,"body":13,"categories":69,"created_at":71,"date_modified":71,"description":63,"extension":72,"faq":71,"featured":73,"kicker_label":71,"meta":74,"navigation":90,"path":91,"published_at":92,"question":71,"scraped_at":93,"seo":94,"sitemap":95,"source_id":96,"source_name":97,"source_type":98,"source_url":99,"stem":100,"tags":101,"thumbnail_url":71,"tldr":106,"tweet":71,"unknown_tags":107,"__hash__":108},"summaries\u002Fsummaries\u002F63e2ecb9ef81ee97-how-adam-s-variance-normalization-fixes-sgd-s-freq-summary.md","How Adam's Variance Normalization Fixes SGD's Frequency Bias",{"provider":7,"model":8,"input_tokens":9,"output_tokens":10,"processing_time_ms":11,"cost_usd":12},"openrouter","google\u002Fgemini-3.1-flash-lite",10587,561,3073,0.00348825,{"type":14,"value":15,"toc":62},"minimark",[16,21,25,29,32,55,59],[17,18,20],"h2",{"id":19},"the-frequency-bias-problem-in-sgd","The Frequency Bias Problem in SGD",[22,23,24],"p",{},"Modern language models rely on training data with highly uneven token distributions. In standard Stochastic Gradient Descent (SGD), every parameter is updated using a fixed learning rate. This creates a significant optimization bottleneck: common tokens receive frequent gradient signals and converge quickly, while rare tokens—which may appear in only 0.1% of batches—receive insufficient updates. Consequently, parameters associated with rare tokens often remain near their random initialization, leading to poor model performance on underrepresented data.",[17,26,28],{"id":27},"how-adam-normalizes-learning-dynamics","How Adam Normalizes Learning Dynamics",[22,30,31],{},"Adam addresses this imbalance through adaptive optimization, specifically via variance normalization. Unlike SGD, Adam maintains a running estimate of the squared gradients (variance) for each parameter independently.",[33,34,35,43,49],"ul",{},[36,37,38,42],"li",{},[39,40,41],"strong",{},"Variance Tracking:"," Adam tracks the historical magnitude of gradients for every parameter.",[36,44,45,48],{},[39,46,47],{},"Adaptive Scaling:"," Before applying an update, Adam divides the learning rate by the square root of the accumulated variance estimate.",[36,50,51,54],{},[39,52,53],{},"Automatic Amplification:"," For rare tokens, the variance estimate remains very small because updates are infrequent. This causes the effective learning rate to be automatically amplified. In a controlled experiment, rare tokens received an effective learning rate over 40 times higher than common tokens, allowing them to converge to the target weight (1.0) despite receiving sparse signals.",[17,56,58],{"id":57},"experimental-evidence","Experimental Evidence",[22,60,61],{},"In a comparative study using a six-token vocabulary with frequencies spanning four orders of magnitude, SGD failed to move rare token weights beyond 0.15–0.53, while Adam successfully pushed all weights toward the target of 1.0. The results demonstrate that Adam acts as an \"automatic equalizer,\" requiring no manual tuning to compensate for frequency imbalance; the variance normalization term derives the necessary scaling directly from the gradient history.",{"title":63,"searchDepth":64,"depth":64,"links":65},"",2,[66,67,68],{"id":19,"depth":64,"text":20},{"id":27,"depth":64,"text":28},{"id":57,"depth":64,"text":58},[70],"AI & LLMs",null,"md",false,{"content_references":75,"triage":84},[76,81],{"type":77,"title":78,"url":79,"context":80},"tool","NumPy","https:\u002F\u002Fnumpy.org\u002F","mentioned",{"type":77,"title":82,"url":83,"context":80},"Matplotlib","https:\u002F\u002Fmatplotlib.org\u002F",{"relevance":85,"novelty":86,"quality":86,"actionability":87,"composite":88,"reasoning":89},5,4,3,4.15,"Category: AI & LLMs. The article provides a deep dive into how Adam's optimization technique addresses a specific problem in training language models, which is highly relevant for AI developers. It presents new insights into variance normalization and its impact on rare token optimization, making it actionable for those looking to improve model performance.",true,"\u002Fsummaries\u002F63e2ecb9ef81ee97-how-adam-s-variance-normalization-fixes-sgd-s-freq-summary","2026-05-18 20:18:55","2026-05-18 23:00:19",{"title":5,"description":63},{"loc":91},"63e2ecb9ef81ee97","MarkTechPost","article","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F18\u002Fstochastic-gradient-descent-sgds-frequency-bias-and-how-adam-fixes-it\u002F","summaries\u002F63e2ecb9ef81ee97-how-adam-s-variance-normalization-fixes-sgd-s-freq-summary",[102,103,104,105],"llm","machine-learning","python","optimization","Standard SGD fails to optimize rare tokens because they receive infrequent gradient updates. Adam solves this by using variance normalization to automatically amplify the effective learning rate for rare parameters.",[105],"_i3B42aRvOxuhgIJqWBCZrpm6JMn6VhobP9Wj9JNeok",[110,112,115,117,120,122,125,128,130,132,134,136,139,141,143,145,147,150,152,154,156,158,161,164,166,168,170,172,174,176,178,180,182,184,186,188,190,192,194,196,198,200,202,204,206,208,210,213,215,217,219,221,223,225,227,229,231,233,235,237,239,242,244,246,248,250,252,254,256,258,260,262,264,266,268,270,272,274,276,278,280,283,285,287,289,291,293,295,297,299,301,303,305,307,309,312,314,316,318,320,322,324,326,328,330,332,334,336,338,340,342,344,346,348,350,352,354,356,358,360,362,364,366,368,370,372,374,377,379,381,383,385,387,389,391,393,395,397,400,402,404,406,408,410,412,414,416,418,420,422,424,426,428,430,433,435,437,439,441,443,445,447,449,451,453,456,458,460,462,464,466,468,470,472,474,476,478,480,482,484,486,488,490,492,494,496,498,500,502,504,506,508,510,512,515,517,519,522,524,526,528,530,532,534,536,538,540,542,544,546,548,550,552,554,556,558,561,563,565,567,569,571,573,575,577,579,581,583,586,588,590,592,594,596,598,600,602,604,606,608,610,612,614,616,618,620,622,624,626,628,630,632,634,636,638,640,642,644,646,648,650,652,654,656,658,660,662,664,666,668,670,672,674,676,678,680,682,684,686,688,690,692,694,696,698,700,702,704,706,708,710,712,714,716,718,720,722,724,726,728,730,732,734,736,738,740,742,744,746,748,750,752,754,756,758,760,762,764,766,768,770,772,774,776,778,780,782,784,786,788,790,792,794,796,798,800,802,804,806,808,810,812,814,816,818,820,822,824,826,828,830,832,834,836,838,840,842,844,846,848,850,852,854,856,858,860,862,864,866,868,870,873,875,877,879,881,884,886,888,890,892,894,896,898,900,902,904,906,908,911,913,915,917,919,921,923,925,927,929,931,933,935,937,939,941,943,945,947,949,951,953,955,957,959,961,963,965,967,969,971,973,975,977,979,981,983,985,987,989,991,993,995,997,999,1001,1003,1005,1007,1009,1011,1013,1015,1017,1019,1021,1023,1025,1027,1029,1031,1033,1035,1037,1039,1041,1043,1045,1047,1049,1051,1053,1055,1057,1059,1061,1063,1065,1067,1069,1071,1073,1075,1077,1079,1081,1083,1085,1087,1089,1091,1093,1095,1097,1099,1101,1103,1105,1107,1109,1111,1113,1115,1117,1119,1121,1123,1125,1127,1129,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1155,1157,1159,1161,1163,1165,1167,1169,1171,1173,1175,1177,1179,1181,1183,1185,1187,1189,1191,1193,1195,1197,1199,1201,1203,1205,1207,1209,1211,1213,1215,1217,1219,1221,1223,1225,1227,1229,1231,1233,1236,1238,1240,1242,1244,1246,1248,1250,1252,1254,1256,1258,1260,1262,1264,1266,1268,1270,1272,1274,1276,1278,1280,1282,1284,1286,1288,1290,1292,1294,1296,1298,1300,1302,1304,1306,1308,1310,1312,1314,1316,1318,1320,1322,1324,1326,1328,1330,1332,1334,1336,1338,1340,1342,1344,1346,1348,1350,1352,1354,1356,1358,1360,1362,1364,1366,1368,1370,1372,1374,1376,1378,1380,1382,1384,1386,1388,1390,1392,1394,1396,1398,1400,1402,1404,1406,1408,1410,1412,1414,1416,1418,1420,1422,1424,1426,1428,1430,1432,1434,1437,1439,1441,1443,1445,1447,1449,1451,1453,1455,1457,1459,1461,1463,1465,1467,1469,1471,1473,1475,1477,1479,1481,1483,1485,1487,1489,1491,1493,1495,1497,1499,1501,1503,1505,1507,1509,1511,1513,1515,1517,1519,1521,1523,1525,1527,1529,1531,1533,1535,1537,1539,1541,1543,1545,1547,1549,1551,1553,1555,1557,1559,1561,1563,1565,1567,1569,1571,1573,1576,1578,1580,1582,1584,1586,1588,1590,1592,1594,1596,1598,1600,1602,1604,1606,1608,1610,1612,1614,1616,1618,1620,1622,1624,1626,1628,1630,1632,1634,1636,1638,1640,1642,1644,1646,1648,1650,1652,1654,1656,1658,1660,1662,1664,1666,1668,1670,1672,1674,1676,1678,1680,1682,1684,1686,1688,1690,1692,1694,1696,1698,1700,1702,1704,1706,1708,1710,1712,1714,1716,1718,1720,1722,1724,1726,1728,1730,1732,1735,1737,1739,1741,1743,1745,1747,1749,1751,1753,1755,1757,1759,1761,1763,1765,1767,1769,1771,1773,1775,1777,1779,1781,1783,1785,1787,1789,1791,1793,1795,1798,1800,1802,1804,1806,1808,1810,1812,1814,1816,1818,1820,1822,1824,1826,1828,1830,1832,1834,1836,1838,1840,1842,1844,1846,1848,1850,1852,1854,1856,1858,1860,1862,1864,1866,1868,1870,1872,1874,1876,1878,1880,1882,1884,1886,1888,1890,1892,1894,1896,1898,1900,1902,1904,1906,1908,1910,1912,1914,1916,1918,1920,1922,1924,1926,1928,1930,1932,1934,1936,1938,1940,1942,1944,1946,1948,1950,1952,1954,1956,1958,1960,1962,1964,1966,1968,1970,1972,1974,1976,1978,1980,1982,1984,1986,1988,1990,1992,1994,1996,1998,2000,2002,2004,2006,2008,2010,2012,2014,2016,2018,2020,2022,2024,2026,2028,2030,2032,2034,2036,2038,2040,2042,2044,2046,2048,2050,2052,2054,2056,2058,2060,2062,2064,2066,2068,2070,2072,2074,2076,2078,2080,2082,2084,2086,2088,2090,2092,2094,2096,2098,2100,2102,2104,2106,2108,2110,2112,2114,2116,2118,2120,2122,2124,2126,2128,2130,2132,2134,2136,2138,2140,2142,2144,2146,2148,2150,2152,2154,2156,2158,2160,2162,2164,2166,2168,2170,2172,2174,2176,2178,2180,2182,2184,2186,2188,2190,2192,2194,2196,2198,2200,2202,2204,2206,2208,2210,2212,2214,2216,2218,2220,2222,2224,2226,2228,2230,2232,2234,2236,2239,2241,2243,2245,2247,2249,2251,2253,2255,2257,2259,2261,2263,2265,2267,2269,2271,2273,2275,2277,2279,2281,2283,2285,2287,2289,2291,2293,2295,2297,2299,2301,2303,2305,2307,2309,2311,2313,2315,2317,2319,2321,2323,2325,2327,2329,2332,2334,2336,2338,2340,2342,2344,2346,2348,2350,2352,2354,2356,2358,2360,2362,2364,2366,2368,2370,2372,2374,2376,2378,2380,2382,2384,2386,2388,2390,2392,2394,2396,2398,2400,2402,2404,2406,2408,2410,2412,2414,2416,2418,2420,2422,2424,2426,2428,2430,2432,2434,2436,2438,2440,2442,2444,2446,2448,2451,2453,2455,2457,2459,2461,2463,2465,2467,2469,2471,2473,2475,2477,2479,2481,2483,2485,2487,2489,2491,2494,2496,2498,2500,2502,2504,2506,2508,2510,2512,2514,2516,2518,2520,2522,2524,2526,2528,2530,2532,2534,2536,2538,2540,2542,2544,2546,2548,2550,2552,2554,2556,2558,2560,2562,2564,2566,2568,2570,2572,2574,2576,2578,2580,2582,2584,2586,2588,2590,2592,2594,2596,2598,2600,2602,2604,2606,2608,2610,2612,2614,2616,2618,2620,2622,2624,2626,2628,2630,2632,2634,2636,2638,2640,2642,2644,2646,2648,2650,2652,2654,2656,2658,2660,2662,2664,2666,2668,2670,2672,2674,2676,2678,2680,2682,2684,2686,2688,2690,2692,2694,2696,2698,2700,2702,2704,2706,2708,2710,2712,2714,2716,2718,2720,2722,2724,2726,2728,2730,2732,2734,2736,2738,2740,2742,2744,2746,2748,2750,2752,2754,2756,2758,2760,2762,2764,2766,2768,2770,2772,2774,2776,2778,2780,2782,2784,2786,2788,2790,2792,2794,2796,2798,2800,2802,2804,2806,2808,2810,2812,2814,2816,2818,2820,2822,2824,2826,2828,2830,2832,2834,2836,2838,2840,2842,2844,2846,2848,2850,2852,2854,2856,2858,2860,2862,2864,2866,2868,2870,2872,2874,2876,2878,2880,2882,2884,2886,2888,2890,2892,2894,2896,2898,2900,2902,2904,2906,2908,2910,2912,2914,2916,2918,2920,2922,2924,2926,2928,2930,2932,2934,2936,2938,2940,2942,2944,2946,2948,2950,2952,2954,2956,2958,2960,2962,2964,2966,2968,2970,2972,2974,2976,2978,2980,2982,2984,2986,2988,2990,2992,2994,2996,2998,3000,3002,3004,3006,3008,3010,3012,3014,3016,3018,3020,3022,3024,3026,3028,3030,3032,3034,3036,3038,3040,3042,3044,3046,3048,3050,3052,3054,3056,3058,3060,3062,3064,3066,3068,3070,3072,3074,3076,3078,3080,3082,3084,3086,3088,3090,3092,3094,3096,3098,3100,3102,3104,3106,3108,3110,3112,3114,3116,3118,3120,3122,3124,3126,3128,3130,3132,3135,3137,3139,3141,3143,3145,3147,3149,3151,3153,3155,3157,3159,3161,3163,3165,3167,3169,3171,3173,3175,3177,3179,3181,3183,3185,3187,3189,3191,3193,3195,3197,3199,3201,3203,3205,3207,3209,3211,3213,3215,3217,3219,3221,3223,3225,3227,3229,3231,3233,3235,3237,3239,3241,3243,3245,3247,3249,3251,3253,3255,3257,3259,3262,3264,3266,3268,3270,3272,3274,3276,3278,3280,3282,3284,3286,3288,3290,3292,3294,3296,3298,3300,3302,3304,3306,3308,3310,3312,3314,3316,3318,3320,3322,3324,3326,3328,3330,3332,3334,3336,3338,3340,3342,3344,3346,3348,3350,3352,3354,3356,3358,3360,3362,3364,3366,3368,3370,3372,3374,3376,3378,3380,3382,3384,3386,3388,3390,3392,3394,3396,3398,3400,3402,3404,3406,3408,3410,3412,3414,3416,3418,3420,3422,3424,3426,3428,3430,3432,3434,3436,3438,3440,3442,3444,3446,3448,3450,3452,3454,3456,3458,3460,3462,3464,3466,3468,3470,3472,3474,3476,3478,3480,3482,3484,3486,3488,3490,3492,3494,3496,3498,3500,3502,3504,3506,3508,3510,3512,3514,3516,3518,3520,3522,3524,3526,3528,3530,3532,3534,3536,3538,3540,3542,3544,3546,3548,3550,3552,3554,3556,3558,3560,3562,3564,3566,3568,3570,3572,3574,3576,3578,3580,3582,3584,3586,3588,3590,3592,3594,3596,3598,3600,3602,3604,3606,3608,3610,3612,3614,3616,3618,3620,3622,3624,3626,3628,3630,3632,3634,3636,3638,3640,3642,3644,3646,3648,3650,3652,3654,3656,3658,3660,3662,3664,3666,3668,3670,3672,3674,3676,3678,3680,3682,3684,3686,3688,3690,3692,3694,3696,3698,3700,3702,3704,3706,3708,3710,3712,3714,3716,3718,3720,3722,3724,3726,3728,3730,3732,3734,3736,3738,3740,3742,3744,3746,3748,3750,3752,3754,3756,3758,3760,3762,3764,3766,3768,3770,3772,3774,3776,3778,3780,3782,3784,3786,3788,3790,3792,3794,3796,3798,3800,3802,3804,3806,3808,3810,3812,3814,3816,3818,3820,3822,3824,3826,3828,3830,3832,3834,3836,3838,3840,3842,3844,3846,3848,3850,3852,3854,3856,3858,3860,3862,3864,3866,3868,3870,3872,3874,3876,3878,3880,3882,3884,3886,3888,3890,3892,3894,3896,3898,3900,3902,3904,3906,3908,3910,3912,3914,3916,3918,3920,3922,3924,3926,3928,3930,3932,3934,3936,3938,3940,3942,3944,3946,3948,3950,3952,3954,3956,3958,3960,3962,3964,3966,3968,3970,3972,3974,3976,3978,3980,3982,3984,3986,3988,3990,3992,3994,3996,3998,4000,4002,4004,4006,4008,4010,4012,4014,4016,4018,4020,4022,4024,4026,4028,4030,4032,4034,4036,4038,4040,4042,4044,4046,4048,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,4150,4152,4154,4156,4158,4160,4162,4164,4166,4168,4170,4172,4174,4176,4178,4180,4182,4184,4186,4188,4190,4192,4194,4196,4198,4200,4202,4204,4206,4208,4210,4212,4214,4216,4218,4220,4222,4224,4226,4228,4230,4232,4234,4236,4238,4240,4242,4244,4246,4248,4250,4252,4254,4256,4258,4260,4262,4264,4266,4268,4270,4272,4274,4276,4278,4280,4282,4284,4286,4288,4290,4292,4294,4296,4298,4300,4302,4304,4306,4308,4310,4312,4314,4316,4318,4320,4322,4324,4326,4328,4330,4332,4334,4336,4338,4340,4342,4344,4346,4348,4350,4352,4354,4356,4358,4360,4362,4364,4366,4368,4370,4372,4374,4376,4378,4380,4382,4384,4386,4388,4390,4392,4394,4396,4398,4400,4402,4404,4406,4408,4410,4412,4414,4416,4418,4420,4422,4424,4426,4428,4430,4432,4434,4436,4438,4440,4442,4444,4446,4448,4450,4452,4454,4456,4458,4460,4462,4464,4466,4468,4470,4472,4474,4476,4478,4480,4482,4484,4486,4488,4490,4492,4494,4496,4498,4500,4502,4504,4506,4508,4510,4512,4514,4516,4518,4520,4522,4524,4526,4528,4530,4532,4534,4536,4538,4540,4542,4544,4547,4549,4551,4553,4555,4557,4559,4561,4563,4565,4567,4569,4571,4573,4575,4577,4579,4581,4583,4585,4587,4589,4591,4593,4595,4597,4599,4601,4603,4605,4607,4609,4611,4613,4615,4617,4619,4621,4623,4625,4627,4629,4631,4633,4635,4637,4639,4641,4643,4645,4647,4649,4651,4653,4655,4657,4659,4661,4663,4665,4667,4669,4671,4673,4675,4677,4679,4681,4683,4685,4687,4689,4691,4693,4695,4697,4699,4701,4703,4705,4707,4709,4711,4713,4715,4717,4719,4721,4723,4725,4727,4729,4731,4733,4735,4737,4739,4741,4743,4745,4747,4749,4751,4753,4755,4757,4759,4761,4763,4765,4767,4769,4771,4773,4775,4777,4779,4781,4783,4785,4787,4789,4791,4793,4795,4797,4799,4801,4803,4805,4807,4809,4811,4813,4815,4817,4819,4821,4823,4825,4827,4829,4831,4833,4835,4837,4839,4841,4843,4845,4847,4849,4851,4853,4855,4857,4859,4861,4863,4865,4867,4869,4871,4873,4875,4877,4879,4881,4883,4885,4887,4889,4891,4893,4895,4897,4899,4901,4903,4905,4907,4909,4911,4913,4915,4917,4919,4921,4923,4925,4927,4929,4931,4933,4935,4937,4939,4941,4943,4945,4947,4949,4951,4953,4955,4957,4959,4961,4963,4965,4967,4969,4971,4973,4975,4977,4979,4981,4983,4985,4987,4989,4991,4993,4995,4997,4999,5001,5003,5005,5007,5009,5011,5013,5015,5017,5019,5021,5023,5025,5027,5029,5031,5033,5035,5037,5039,5041,5043,5045,5047,5049,5051,5053,5055,5057,5059,5061,5063,5065,5067,5069,5071,5073,5075,5077,5079,5081,5083,5085,5087,5089,5091,5093,5095,5097,5099,5101,5103,5105,5107,5109,5111,5113,5115,5117,5119,5121,5123,5125,5127,5129,5131,5133,5135,5137,5139,5141,5143,5145,5147,5149,5151,5153,5155,5157,5159,5161,5163,5165,5167,5169,5171,5173,5175,5177,5179,5181,5183,5185,5187,5189,5191,5193,5195,5197,5199,5201,5203,5205,5207,5209,5211,5213,5215,5217,5219,5221,5223,5225,5227,5229,5231,5233,5235,5237,5239,5241,5243,5245,5247,5249,5251,5253,5255,5257,5259,5261,5263,5265,5267,5269,5271,5273,5275,5277,5279,5281,5283,5285,5287,5289,5291,5293,5295,5297,5299,5301,5303,5305,5307,5309,5311,5313,5315,5317,5319,5321,5323,5325,5327,5329,5331,5333,5335,5337,5339,5341,5343,5345,5347,5349,5351,5353,5355,5357,5359,5361,5363,5365,5367,5369,5371,5373,5375,5377,5379,5381,5383,5385,5387,5389,5391,5393,5395,5397,5399,5401,5404,5406,5408,5410,5412,5414,5416,5418,5420,5422,5424,5426,5428,5430,5432,5434,5436,5438,5440,5442,5444,5446,5448,5450,5452,5454,5456,5458,5460,5462,5464,5466,5468,5470,5472,5474,5476,5478,5480,5482,5484,5486,5488,5490,5492,5494,5496,5498,5500,5502,5504,5506,5508,5510,5512,5514,5516,5518,5520,5522,5524,5526,5528,5530,5532,5534,5536,5538,5540,5542,5544,5546,5548,5550,5552,5554,5556,5558,5560,5562,5564,5566,5568,5570,5572,5574,5576,5578,5580,5582,5584,5586,5588,5590,5592,5594,5596,5598,5600,5602,5604,5607,5609,5611,5613,5615,5617,5619,5621,5623,5625,5627,5629,5631,5633,5635,5637,5639,5641,5643,5645,5647,5649,5651,5653,5655,5657,5659,5661,5663,5665,5667,5669,5671,5673,5675,5677,5679,5681,5683,5685,5687,5689,5691,5693,5695,5697,5699,5701,5703,5705,5707,5709,5711,5713,5715,5717,5719,5721,5723,5725,5727,5729,5731,5733,5735,5737,5739,5741,5743,5745,5747,5749,5751,5753,5755,5757,5759,5761,5763,5765,5767,5769,5771,5773,5775,5777,5779,5781,5783,5785,5787,5789,5791,5793,5795,5797,5799,5801,5803,5805,5807,5809,5811,5813,5815,5817,5819,5821,5823,5825,5827,5829,5831,5833,5835,5837,5839,5841,5843,5845,5847,5849,5851,5853,5855,5857,5859,5861,5863,5865,5867,5869,5871,5873,5875,5877,5879,5881,5883,5885,5887,5889,5891,5893,5895,5897,5899,5901,5903,5905,5907,5909,5911,5913,5915,5917,5919,5921,5923,5925,5927,5929,5931,5933,5935,5937,5939,5941,5943,5945,5947,5949,5951,5953,5955,5957,5959,5961,5963,5965,5967,5969,5971,5973,5975,5977,5979,5981,5983,5985,5987,5989,5991,5993,5995,5997,5999,6001,6003,6005,6007,6009,6011,6013,6015,6017,6019,6021,6023,6025,6027,6029,6031,6033,6035,6037,6039,6041,6043,6045,6047,6049,6051,6053,6055,6057,6059,6061,6063,6065,6067,6069,6071,6073,6075,6077,6079,6081,6083,6085,6087,6089,6091,6093,6095,6097,6099,6101,6103,6105,6107,6109,6111,6113,6115,6117,6119,6121,6123,6125,6127,6129,6131,6133,6135,6137,6139,6141,6143,6145,6147,6149,6151,6153,6155,6157,6159,6161,6163,6165,6167,6169,6171,6173,6175,6177,6179,6181,6183,6185,6187,6189,6191,6193,6195,6197,6199,6201,6203,6205,6207,6209,6211,6213,6215,6217,6219,6221,6223,6225,6227,6229,6231,6233,6235,6237,6239,6241,6243,6245,6247,6249,6251,6253,6255,6257,6259,6261,6263,6265,6267,6269,6271,6273,6275,6277,6279,6281,6283,6285,6287,6289,6291,6293,6295,6297,6299,6301,6303,6305,6307,6309,6311,6313,6315,6317,6319,6321,6323,6325,6327,6329,6331,6333,6335,6337,6339,6341,6343,6345,6347,6349,6351,6353,6355,6357,6359,6361,6363,6365,6367,6369,6371,6373,6375,6377,6379,6381,6383,6385,6387,6389,6391,6393,6395,6397,6399,6401,6403,6405,6407,6409,6411,6413,6415,6417,6419,6421,6423,6425,6427,6429,6431,6433,6435,6437,6439,6441,6443,6445,6447,6449,6451,6453,6455,6457,6459,6461,6463,6465,6467,6469,6471,6473,6475,6477,6479,6481,6483,6485,6487,6489,6491,6493,6495,6497,6499,6501,6503,6505,6507,6509,6511,6513,6515,6517,6519,6521,6523,6525,6527,6529,6531,6533,6535,6537,6539,6541,6543,6545,6547,6549,6551,6553,6555,6557,6559,6561,6563,6565,6567,6569,6571,6573,6575,6577,6579,6581,6583,6585,6587,6589,6591,6593,6595,6597,6599,6601,6603,6605,6607,6609,6611,6613,6615,6617,6619,6621,6623,6625,6627,6629,6631,6633,6635,6637,6639,6641,6643,6645,6647,6649,6651,6653,6655,6657,6659,6661,6663,6665,6667,6669,6671,6673,6675,6677,6679,6681,6683,6685,6687,6689,6691,6693,6695,6697,6699,6701,6703,6705,6707,6709,6711,6713,6715,6717,6719,6721,6723,6725,6727,6729,6731,6733,6735,6737,6739,6741,6743,6745,6747,6749,6751,6753,6755,6757,6759,6761,6763,6765,6767,6769,6771,6773,6775,6777,6779,6781,6783,6785,6787,6789,6791,6793,6795,6797,6799,6801,6803,6805,6807,6809,6811,6813,6815,6817,6819,6821,6823,6825,6827,6829,6831,6833,6835,6837,6839,6841,6843,6845,6847,6849,6851,6853,6855,6857,6859,6861,6863,6865,6867,6869,6871,6873,6875,6877,6879,6881,6883,6885,6887,6889,6891,6893,6895,6897,6899,6901,6903,6905,6907,6909,6911,6913,6915,6917,6919,6921,6923,6925,6927,6929,6931,6933,6935,6937,6939,6941,6943,6945,6947,6949,6951,6953,6955,6957,6959,6961,6963,6965,6967,6969,6971,6973,6975,6977,6979,6981,6983,6985,6987,6989,6991,6993,6995,6997,6999,7001,7003,7005,7007,7009,7011],{"categories":111},[70],{"categories":113},[114],"Developer Productivity",{"categories":116},[70],{"categories":118},[119],"Business & SaaS",{"categories":121},[70],{"categories":123},[124],"AI Automation",{"categories":126},[127],"Product Strategy",{"categories":129},[124],{"categories":131},[70],{"categories":133},[114],{"categories":135},[124],{"categories":137},[138],"Software Engineering",{"categories":140},[70],{"categories":142},[119],{"categories":144},[],{"categories":146},[70],{"categories":148},[149],"Inference & Serving",{"categories":151},[70],{"categories":153},[70],{"categories":155},[124],{"categories":157},[],{"categories":159},[160],"AI News & Trends",{"categories":162},[163],"Data Science & Visualization",{"categories":165},[124],{"categories":167},[70],{"categories":169},[70],{"categories":171},[119],{"categories":173},[114],{"categories":175},[70],{"categories":177},[124],{"categories":179},[160],{"categories":181},[70],{"categories":183},[124],{"categories":185},[124],{"categories":187},[70],{"categories":189},[70],{"categories":191},[124],{"categories":193},[70],{"categories":195},[70],{"categories":197},[70],{"categories":199},[124],{"categories":201},[160],{"categories":203},[70],{"categories":205},[70],{"categories":207},[70],{"categories":209},[],{"categories":211},[212],"Design & Frontend",{"categories":214},[163],{"categories":216},[160],{"categories":218},[70],{"categories":220},[70],{"categories":222},[70],{"categories":224},[],{"categories":226},[70],{"categories":228},[70],{"categories":230},[124],{"categories":232},[138],{"categories":234},[70],{"categories":236},[124],{"categories":238},[70],{"categories":240},[241],"Marketing & Growth",{"categories":243},[212],{"categories":245},[70],{"categories":247},[124],{"categories":249},[70],{"categories":251},[70],{"categories":253},[138],{"categories":255},[70],{"categories":257},[],{"categories":259},[],{"categories":261},[212],{"categories":263},[70],{"categories":265},[124],{"categories":267},[114],{"categories":269},[138],{"categories":271},[124],{"categories":273},[212],{"categories":275},[127],{"categories":277},[70],{"categories":279},[138],{"categories":281},[282],"DevOps & Cloud",{"categories":284},[124],{"categories":286},[127],{"categories":288},[160],{"categories":290},[70],{"categories":292},[],{"categories":294},[70],{"categories":296},[70],{"categories":298},[],{"categories":300},[124],{"categories":302},[138],{"categories":304},[],{"categories":306},[138],{"categories":308},[70],{"categories":310},[311],"Governance & Standards",{"categories":313},[119],{"categories":315},[],{"categories":317},[],{"categories":319},[70],{"categories":321},[70],{"categories":323},[124],{"categories":325},[70],{"categories":327},[70],{"categories":329},[124],{"categories":331},[70],{"categories":333},[70],{"categories":335},[70],{"categories":337},[],{"categories":339},[138],{"categories":341},[],{"categories":343},[],{"categories":345},[70],{"categories":347},[138],{"categories":349},[],{"categories":351},[138],{"categories":353},[70],{"categories":355},[70],{"categories":357},[241],{"categories":359},[70],{"categories":361},[70],{"categories":363},[70],{"categories":365},[212],{"categories":367},[212],{"categories":369},[70],{"categories":371},[138],{"categories":373},[124],{"categories":375},[376],"GovTech & Public-Sector Adoption",{"categories":378},[138],{"categories":380},[70],{"categories":382},[70],{"categories":384},[70],{"categories":386},[124],{"categories":388},[124],{"categories":390},[163],{"categories":392},[70],{"categories":394},[160],{"categories":396},[124],{"categories":398},[399],"Legal AI Tools",{"categories":401},[70],{"categories":403},[124],{"categories":405},[70],{"categories":407},[241],{"categories":409},[124],{"categories":411},[127],{"categories":413},[70],{"categories":415},[138],{"categories":417},[376],{"categories":419},[],{"categories":421},[124],{"categories":423},[],{"categories":425},[119],{"categories":427},[124],{"categories":429},[124],{"categories":431},[432],"RAG & Retrieval",{"categories":434},[119],{"categories":436},[70],{"categories":438},[138],{"categories":440},[138],{"categories":442},[282],{"categories":444},[212],{"categories":446},[124],{"categories":448},[70],{"categories":450},[70],{"categories":452},[],{"categories":454},[455],"Agents & Orchestration",{"categories":457},[138],{"categories":459},[70],{"categories":461},[],{"categories":463},[124],{"categories":465},[119],{"categories":467},[],{"categories":469},[70],{"categories":471},[],{"categories":473},[70],{"categories":475},[114],{"categories":477},[138],{"categories":479},[119],{"categories":481},[70],{"categories":483},[124],{"categories":485},[70],{"categories":487},[160],{"categories":489},[70],{"categories":491},[],{"categories":493},[70],{"categories":495},[],{"categories":497},[70],{"categories":499},[138],{"categories":501},[70],{"categories":503},[124],{"categories":505},[163],{"categories":507},[],{"categories":509},[70],{"categories":511},[212],{"categories":513},[514],"Models & Frontier Labs",{"categories":516},[],{"categories":518},[212],{"categories":520},[521],"Regulation & Governance of AI",{"categories":523},[127],{"categories":525},[124],{"categories":527},[],{"categories":529},[70],{"categories":531},[70],{"categories":533},[124],{"categories":535},[124],{"categories":537},[160],{"categories":539},[70],{"categories":541},[119],{"categories":543},[70],{"categories":545},[124],{"categories":547},[],{"categories":549},[138],{"categories":551},[124],{"categories":553},[70],{"categories":555},[127],{"categories":557},[70],{"categories":559},[560],"AI Policy & Regulation",{"categories":562},[],{"categories":564},[70],{"categories":566},[124],{"categories":568},[127],{"categories":570},[124],{"categories":572},[70],{"categories":574},[70],{"categories":576},[70],{"categories":578},[124],{"categories":580},[],{"categories":582},[163],{"categories":584},[585],"Evals & Reliability",{"categories":587},[70],{"categories":589},[70],{"categories":591},[],{"categories":593},[114],{"categories":595},[376],{"categories":597},[560],{"categories":599},[70],{"categories":601},[119],{"categories":603},[70],{"categories":605},[124],{"categories":607},[70],{"categories":609},[124],{"categories":611},[455],{"categories":613},[70],{"categories":615},[138],{"categories":617},[70],{"categories":619},[],{"categories":621},[212],{"categories":623},[],{"categories":625},[70],{"categories":627},[376],{"categories":629},[70],{"categories":631},[70],{"categories":633},[70],{"categories":635},[],{"categories":637},[70],{"categories":639},[212],{"categories":641},[138],{"categories":643},[],{"categories":645},[70],{"categories":647},[],{"categories":649},[124],{"categories":651},[70],{"categories":653},[212],{"categories":655},[],{"categories":657},[70],{"categories":659},[70],{"categories":661},[163],{"categories":663},[124],{"categories":665},[70],{"categories":667},[119],{"categories":669},[124],{"categories":671},[70],{"categories":673},[70],{"categories":675},[138],{"categories":677},[212],{"categories":679},[70],{"categories":681},[124],{"categories":683},[],{"categories":685},[138],{"categories":687},[124],{"categories":689},[163],{"categories":691},[],{"categories":693},[70],{"categories":695},[160],{"categories":697},[70],{"categories":699},[],{"categories":701},[70],{"categories":703},[70],{"categories":705},[70],{"categories":707},[119,241],{"categories":709},[],{"categories":711},[138],{"categories":713},[70],{"categories":715},[70],{"categories":717},[124],{"categories":719},[70],{"categories":721},[],{"categories":723},[],{"categories":725},[70],{"categories":727},[212],{"categories":729},[70],{"categories":731},[],{"categories":733},[70],{"categories":735},[282],{"categories":737},[],{"categories":739},[124],{"categories":741},[160],{"categories":743},[70],{"categories":745},[70],{"categories":747},[212],{"categories":749},[],{"categories":751},[160],{"categories":753},[70],{"categories":755},[149],{"categories":757},[70],{"categories":759},[70],{"categories":761},[124],{"categories":763},[160],{"categories":765},[514],{"categories":767},[70],{"categories":769},[241],{"categories":771},[],{"categories":773},[124],{"categories":775},[119],{"categories":777},[138],{"categories":779},[70],{"categories":781},[124],{"categories":783},[],{"categories":785},[70,282],{"categories":787},[70],{"categories":789},[70],{"categories":791},[70],{"categories":793},[124],{"categories":795},[70,138],{"categories":797},[163],{"categories":799},[70],{"categories":801},[70],{"categories":803},[70],{"categories":805},[138],{"categories":807},[70],{"categories":809},[124],{"categories":811},[124],{"categories":813},[560],{"categories":815},[241],{"categories":817},[70],{"categories":819},[124],{"categories":821},[70],{"categories":823},[70],{"categories":825},[124],{"categories":827},[],{"categories":829},[124],{"categories":831},[70],{"categories":833},[70],{"categories":835},[124],{"categories":837},[70],{"categories":839},[70,119],{"categories":841},[70],{"categories":843},[119],{"categories":845},[],{"categories":847},[212],{"categories":849},[212],{"categories":851},[70],{"categories":853},[],{"categories":855},[],{"categories":857},[70],{"categories":859},[160],{"categories":861},[],{"categories":863},[114],{"categories":865},[70],{"categories":867},[138],{"categories":869},[70],{"categories":871},[872],"Generative UI & Design-to-Code",{"categories":874},[70],{"categories":876},[70],{"categories":878},[212],{"categories":880},[70],{"categories":882},[883],"Algorithmic Accountability",{"categories":885},[124],{"categories":887},[138],{"categories":889},[160],{"categories":891},[212],{"categories":893},[70],{"categories":895},[],{"categories":897},[127],{"categories":899},[70],{"categories":901},[70],{"categories":903},[70],{"categories":905},[70],{"categories":907},[124],{"categories":909},[910],"MLOps & Infrastructure",{"categories":912},[70],{"categories":914},[70],{"categories":916},[70],{"categories":918},[70],{"categories":920},[70],{"categories":922},[138],{"categories":924},[160],{"categories":926},[70],{"categories":928},[127],{"categories":930},[114],{"categories":932},[70],{"categories":934},[124],{"categories":936},[282],{"categories":938},[70],{"categories":940},[119],{"categories":942},[70],{"categories":944},[212],{"categories":946},[70],{"categories":948},[70],{"categories":950},[124],{"categories":952},[],{"categories":954},[],{"categories":956},[70],{"categories":958},[149],{"categories":960},[212],{"categories":962},[160],{"categories":964},[163],{"categories":966},[],{"categories":968},[70],{"categories":970},[70],{"categories":972},[119],{"categories":974},[124],{"categories":976},[70],{"categories":978},[70],{"categories":980},[70],{"categories":982},[70],{"categories":984},[160],{"categories":986},[149],{"categories":988},[70],{"categories":990},[212],{"categories":992},[70],{"categories":994},[],{"categories":996},[124],{"categories":998},[138],{"categories":1000},[],{"categories":1002},[70],{"categories":1004},[70],{"categories":1006},[124],{"categories":1008},[138],{"categories":1010},[70],{"categories":1012},[163],{"categories":1014},[212],{"categories":1016},[],{"categories":1018},[70],{"categories":1020},[],{"categories":1022},[70],{"categories":1024},[],{"categories":1026},[70],{"categories":1028},[70],{"categories":1030},[127],{"categories":1032},[119],{"categories":1034},[124],{"categories":1036},[124],{"categories":1038},[],{"categories":1040},[70],{"categories":1042},[114],{"categories":1044},[70],{"categories":1046},[70],{"categories":1048},[119],{"categories":1050},[160],{"categories":1052},[114],{"categories":1054},[],{"categories":1056},[70],{"categories":1058},[],{"categories":1060},[70],{"categories":1062},[],{"categories":1064},[160],{"categories":1066},[160],{"categories":1068},[],{"categories":1070},[455],{"categories":1072},[70],{"categories":1074},[212],{"categories":1076},[138],{"categories":1078},[],{"categories":1080},[399],{"categories":1082},[124],{"categories":1084},[119],{"categories":1086},[],{"categories":1088},[],{"categories":1090},[114],{"categories":1092},[163],{"categories":1094},[],{"categories":1096},[241],{"categories":1098},[124],{"categories":1100},[119],{"categories":1102},[124],{"categories":1104},[70],{"categories":1106},[119],{"categories":1108},[70],{"categories":1110},[138],{"categories":1112},[],{"categories":1114},[149],{"categories":1116},[127],{"categories":1118},[70],{"categories":1120},[212],{"categories":1122},[138],{"categories":1124},[119],{"categories":1126},[70],{"categories":1128},[138],{"categories":1130},[70],{"categories":1132},[124],{"categories":1134},[119],{"categories":1136},[70],{"categories":1138},[70],{"categories":1140},[70],{"categories":1142},[70],{"categories":1144},[70],{"categories":1146},[],{"categories":1148},[],{"categories":1150},[138],{"categories":1152},[163],{"categories":1154},[127],{"categories":1156},[70],{"categories":1158},[124],{"categories":1160},[138],{"categories":1162},[138],{"categories":1164},[70],{"categories":1166},[],{"categories":1168},[160],{"categories":1170},[127],{"categories":1172},[127],{"categories":1174},[138],{"categories":1176},[70],{"categories":1178},[585],{"categories":1180},[282],{"categories":1182},[],{"categories":1184},[124],{"categories":1186},[70],{"categories":1188},[],{"categories":1190},[114],{"categories":1192},[],{"categories":1194},[70],{"categories":1196},[70],{"categories":1198},[70],{"categories":1200},[212],{"categories":1202},[241],{"categories":1204},[70],{"categories":1206},[138],{"categories":1208},[70],{"categories":1210},[124],{"categories":1212},[],{"categories":1214},[138],{"categories":1216},[70],{"categories":1218},[114],{"categories":1220},[],{"categories":1222},[119],{"categories":1224},[70],{"categories":1226},[70],{"categories":1228},[160],{"categories":1230},[70,282],{"categories":1232},[70],{"categories":1234},[1235],"Design Systems for AI",{"categories":1237},[70],{"categories":1239},[70],{"categories":1241},[160],{"categories":1243},[70],{"categories":1245},[70],{"categories":1247},[70],{"categories":1249},[119],{"categories":1251},[70],{"categories":1253},[70],{"categories":1255},[70],{"categories":1257},[],{"categories":1259},[70],{"categories":1261},[70],{"categories":1263},[119],{"categories":1265},[70],{"categories":1267},[],{"categories":1269},[124],{"categories":1271},[124],{"categories":1273},[138],{"categories":1275},[160],{"categories":1277},[138],{"categories":1279},[70],{"categories":1281},[212],{"categories":1283},[160],{"categories":1285},[163],{"categories":1287},[70],{"categories":1289},[70],{"categories":1291},[124],{"categories":1293},[114],{"categories":1295},[560],{"categories":1297},[70],{"categories":1299},[124],{"categories":1301},[70],{"categories":1303},[138],{"categories":1305},[138],{"categories":1307},[],{"categories":1309},[],{"categories":1311},[70],{"categories":1313},[124],{"categories":1315},[127],{"categories":1317},[],{"categories":1319},[119],{"categories":1321},[70],{"categories":1323},[],{"categories":1325},[212],{"categories":1327},[138],{"categories":1329},[124],{"categories":1331},[138],{"categories":1333},[212],{"categories":1335},[70],{"categories":1337},[70],{"categories":1339},[212],{"categories":1341},[],{"categories":1343},[],{"categories":1345},[160],{"categories":1347},[124],{"categories":1349},[124],{"categories":1351},[70],{"categories":1353},[70],{"categories":1355},[70],{"categories":1357},[70],{"categories":1359},[119],{"categories":1361},[70],{"categories":1363},[70],{"categories":1365},[],{"categories":1367},[138],{"categories":1369},[138],{"categories":1371},[70],{"categories":1373},[138],{"categories":1375},[119],{"categories":1377},[],{"categories":1379},[70],{"categories":1381},[70],{"categories":1383},[70],{"categories":1385},[70],{"categories":1387},[70],{"categories":1389},[124],{"categories":1391},[114],{"categories":1393},[119],{"categories":1395},[70],{"categories":1397},[124],{"categories":1399},[160],{"categories":1401},[124],{"categories":1403},[149],{"categories":1405},[241],{"categories":1407},[70],{"categories":1409},[124],{"categories":1411},[70],{"categories":1413},[70],{"categories":1415},[70],{"categories":1417},[],{"categories":1419},[212],{"categories":1421},[],{"categories":1423},[70],{"categories":1425},[70],{"categories":1427},[],{"categories":1429},[70],{"categories":1431},[138],{"categories":1433},[119],{"categories":1435},[1436],"Visual & Generative Media",{"categories":1438},[124],{"categories":1440},[],{"categories":1442},[70],{"categories":1444},[70],{"categories":1446},[138],{"categories":1448},[282],{"categories":1450},[70],{"categories":1452},[163],{"categories":1454},[560],{"categories":1456},[138],{"categories":1458},[241],{"categories":1460},[70],{"categories":1462},[212],{"categories":1464},[70],{"categories":1466},[70],{"categories":1468},[138],{"categories":1470},[124],{"categories":1472},[70],{"categories":1474},[],{"categories":1476},[],{"categories":1478},[124],{"categories":1480},[138],{"categories":1482},[114],{"categories":1484},[124],{"categories":1486},[514],{"categories":1488},[70],{"categories":1490},[127],{"categories":1492},[70],{"categories":1494},[119],{"categories":1496},[],{"categories":1498},[70],{"categories":1500},[127],{"categories":1502},[70],{"categories":1504},[70],{"categories":1506},[70],{"categories":1508},[127],{"categories":1510},[70],{"categories":1512},[70],{"categories":1514},[241],{"categories":1516},[70],{"categories":1518},[455],{"categories":1520},[70],{"categories":1522},[124],{"categories":1524},[70],{"categories":1526},[70],{"categories":1528},[70],{"categories":1530},[70],{"categories":1532},[212],{"categories":1534},[124],{"categories":1536},[],{"categories":1538},[124],{"categories":1540},[],{"categories":1542},[282],{"categories":1544},[138],{"categories":1546},[],{"categories":1548},[514],{"categories":1550},[70],{"categories":1552},[124],{"categories":1554},[124],{"categories":1556},[70],{"categories":1558},[212,70],{"categories":1560},[114],{"categories":1562},[70],{"categories":1564},[212],{"categories":1566},[],{"categories":1568},[70],{"categories":1570},[114],{"categories":1572},[70],{"categories":1574},[1575],"Medical Imaging & Radiology",{"categories":1577},[70],{"categories":1579},[70],{"categories":1581},[70],{"categories":1583},[212],{"categories":1585},[124],{"categories":1587},[138],{"categories":1589},[],{"categories":1591},[70],{"categories":1593},[70],{"categories":1595},[70],{"categories":1597},[],{"categories":1599},[],{"categories":1601},[70],{"categories":1603},[70],{"categories":1605},[455],{"categories":1607},[70],{"categories":1609},[114],{"categories":1611},[70],{"categories":1613},[70],{"categories":1615},[],{"categories":1617},[124],{"categories":1619},[70],{"categories":1621},[127],{"categories":1623},[138],{"categories":1625},[70],{"categories":1627},[124],{"categories":1629},[455],{"categories":1631},[70],{"categories":1633},[124],{"categories":1635},[70],{"categories":1637},[70],{"categories":1639},[70],{"categories":1641},[212],{"categories":1643},[124],{"categories":1645},[282],{"categories":1647},[212],{"categories":1649},[119],{"categories":1651},[124],{"categories":1653},[160],{"categories":1655},[70],{"categories":1657},[70],{"categories":1659},[127],{"categories":1661},[70],{"categories":1663},[70],{"categories":1665},[70],{"categories":1667},[70],{"categories":1669},[124],{"categories":1671},[70],{"categories":1673},[138],{"categories":1675},[138],{"categories":1677},[70],{"categories":1679},[127],{"categories":1681},[],{"categories":1683},[160],{"categories":1685},[],{"categories":1687},[127],{"categories":1689},[124],{"categories":1691},[70],{"categories":1693},[124],{"categories":1695},[1235],{"categories":1697},[1235],{"categories":1699},[212],{"categories":1701},[70],{"categories":1703},[70],{"categories":1705},[70],{"categories":1707},[124],{"categories":1709},[138],{"categories":1711},[212],{"categories":1713},[124],{"categories":1715},[160],{"categories":1717},[],{"categories":1719},[70],{"categories":1721},[],{"categories":1723},[70],{"categories":1725},[70],{"categories":1727},[70],{"categories":1729},[70],{"categories":1731},[124],{"categories":1733},[1734],"Contract Review & E-Discovery",{"categories":1736},[70],{"categories":1738},[212],{"categories":1740},[70],{"categories":1742},[114],{"categories":1744},[70],{"categories":1746},[160],{"categories":1748},[70],{"categories":1750},[70],{"categories":1752},[241],{"categories":1754},[138],{"categories":1756},[70],{"categories":1758},[70],{"categories":1760},[124],{"categories":1762},[124],{"categories":1764},[883],{"categories":1766},[70],{"categories":1768},[70],{"categories":1770},[124],{"categories":1772},[124],{"categories":1774},[70],{"categories":1776},[70],{"categories":1778},[70],{"categories":1780},[124],{"categories":1782},[70],{"categories":1784},[70],{"categories":1786},[455],{"categories":1788},[432],{"categories":1790},[70],{"categories":1792},[124],{"categories":1794},[70],{"categories":1796},[1797],"Law-Firm Practice & Adoption",{"categories":1799},[70],{"categories":1801},[124],{"categories":1803},[212],{"categories":1805},[70],{"categories":1807},[70],{"categories":1809},[70],{"categories":1811},[],{"categories":1813},[],{"categories":1815},[138],{"categories":1817},[70],{"categories":1819},[],{"categories":1821},[124],{"categories":1823},[114],{"categories":1825},[282],{"categories":1827},[70],{"categories":1829},[],{"categories":1831},[114],{"categories":1833},[119],{"categories":1835},[70],{"categories":1837},[241],{"categories":1839},[],{"categories":1841},[119],{"categories":1843},[124],{"categories":1845},[119],{"categories":1847},[],{"categories":1849},[70],{"categories":1851},[127],{"categories":1853},[70],{"categories":1855},[138],{"categories":1857},[],{"categories":1859},[],{"categories":1861},[],{"categories":1863},[],{"categories":1865},[70],{"categories":1867},[127],{"categories":1869},[124],{"categories":1871},[282],{"categories":1873},[70],{"categories":1875},[114],{"categories":1877},[138],{"categories":1879},[70],{"categories":1881},[70],{"categories":1883},[138],{"categories":1885},[127],{"categories":1887},[70],{"categories":1889},[70],{"categories":1891},[70],{"categories":1893},[910],{"categories":1895},[70],{"categories":1897},[138],{"categories":1899},[70],{"categories":1901},[241],{"categories":1903},[138],{"categories":1905},[119],{"categories":1907},[70],{"categories":1909},[70],{"categories":1911},[70],{"categories":1913},[212],{"categories":1915},[70],{"categories":1917},[70],{"categories":1919},[70],{"categories":1921},[70],{"categories":1923},[119],{"categories":1925},[124],{"categories":1927},[70,114],{"categories":1929},[455],{"categories":1931},[70],{"categories":1933},[70],{"categories":1935},[138],{"categories":1937},[138],{"categories":1939},[212],{"categories":1941},[124],{"categories":1943},[124],{"categories":1945},[138],{"categories":1947},[70],{"categories":1949},[70],{"categories":1951},[70],{"categories":1953},[],{"categories":1955},[],{"categories":1957},[70],{"categories":1959},[163],{"categories":1961},[70],{"categories":1963},[124],{"categories":1965},[],{"categories":1967},[70],{"categories":1969},[70],{"categories":1971},[138],{"categories":1973},[163],{"categories":1975},[160],{"categories":1977},[212],{"categories":1979},[70],{"categories":1981},[124],{"categories":1983},[70],{"categories":1985},[138],{"categories":1987},[],{"categories":1989},[124],{"categories":1991},[70],{"categories":1993},[70],{"categories":1995},[70],{"categories":1997},[70],{"categories":1999},[],{"categories":2001},[124],{"categories":2003},[70],{"categories":2005},[70],{"categories":2007},[70],{"categories":2009},[],{"categories":2011},[124],{"categories":2013},[70],{"categories":2015},[70],{"categories":2017},[119],{"categories":2019},[70],{"categories":2021},[70],{"categories":2023},[],{"categories":2025},[114],{"categories":2027},[70],{"categories":2029},[70],{"categories":2031},[70],{"categories":2033},[212],{"categories":2035},[70],{"categories":2037},[138],{"categories":2039},[70],{"categories":2041},[114],{"categories":2043},[70],{"categories":2045},[138],{"categories":2047},[241],{"categories":2049},[124],{"categories":2051},[124],{"categories":2053},[70],{"categories":2055},[70],{"categories":2057},[70,212],{"categories":2059},[70],{"categories":2061},[124],{"categories":2063},[160],{"categories":2065},[70],{"categories":2067},[160],{"categories":2069},[124],{"categories":2071},[212],{"categories":2073},[70],{"categories":2075},[],{"categories":2077},[138],{"categories":2079},[282],{"categories":2081},[212],{"categories":2083},[138],{"categories":2085},[70],{"categories":2087},[127],{"categories":2089},[70],{"categories":2091},[70],{"categories":2093},[124],{"categories":2095},[],{"categories":2097},[],{"categories":2099},[70],{"categories":2101},[],{"categories":2103},[],{"categories":2105},[127],{"categories":2107},[138],{"categories":2109},[70],{"categories":2111},[124],{"categories":2113},[124],{"categories":2115},[119],{"categories":2117},[124],{"categories":2119},[282],{"categories":2121},[70],{"categories":2123},[70],{"categories":2125},[70],{"categories":2127},[149],{"categories":2129},[70],{"categories":2131},[70],{"categories":2133},[70],{"categories":2135},[138],{"categories":2137},[124],{"categories":2139},[70],{"categories":2141},[70],{"categories":2143},[138],{"categories":2145},[399],{"categories":2147},[124],{"categories":2149},[883],{"categories":2151},[],{"categories":2153},[212],{"categories":2155},[1797],{"categories":2157},[138],{"categories":2159},[],{"categories":2161},[],{"categories":2163},[70],{"categories":2165},[124],{"categories":2167},[],{"categories":2169},[],{"categories":2171},[70],{"categories":2173},[241],{"categories":2175},[70],{"categories":2177},[241],{"categories":2179},[124],{"categories":2181},[70],{"categories":2183},[70],{"categories":2185},[138],{"categories":2187},[127],{"categories":2189},[],{"categories":2191},[70],{"categories":2193},[70],{"categories":2195},[138],{"categories":2197},[1734],{"categories":2199},[212],{"categories":2201},[212],{"categories":2203},[70],{"categories":2205},[124],{"categories":2207},[114],{"categories":2209},[70],{"categories":2211},[70],{"categories":2213},[70],{"categories":2215},[70],{"categories":2217},[212],{"categories":2219},[212],{"categories":2221},[124],{"categories":2223},[124],{"categories":2225},[124],{"categories":2227},[70],{"categories":2229},[70],{"categories":2231},[],{"categories":2233},[70],{"categories":2235},[],{"categories":2237},[2238],"Interaction & Product Design",{"categories":2240},[70],{"categories":2242},[124],{"categories":2244},[138],{"categories":2246},[311],{"categories":2248},[160],{"categories":2250},[138],{"categories":2252},[70],{"categories":2254},[70],{"categories":2256},[70],{"categories":2258},[138],{"categories":2260},[70],{"categories":2262},[114],{"categories":2264},[124],{"categories":2266},[70],{"categories":2268},[],{"categories":2270},[124],{"categories":2272},[124],{"categories":2274},[124],{"categories":2276},[],{"categories":2278},[138],{"categories":2280},[70],{"categories":2282},[124],{"categories":2284},[114],{"categories":2286},[2238],{"categories":2288},[70],{"categories":2290},[114],{"categories":2292},[114],{"categories":2294},[],{"categories":2296},[124],{"categories":2298},[138],{"categories":2300},[],{"categories":2302},[124],{"categories":2304},[160],{"categories":2306},[70],{"categories":2308},[124],{"categories":2310},[70],{"categories":2312},[124],{"categories":2314},[124],{"categories":2316},[70],{"categories":2318},[70],{"categories":2320},[160],{"categories":2322},[163],{"categories":2324},[70],{"categories":2326},[127],{"categories":2328},[138],{"categories":2330},[2331],"Coding Agents & Dev Productivity",{"categories":2333},[160],{"categories":2335},[212],{"categories":2337},[70],{"categories":2339},[70],{"categories":2341},[],{"categories":2343},[70],{"categories":2345},[883],{"categories":2347},[],{"categories":2349},[70],{"categories":2351},[70],{"categories":2353},[282],{"categories":2355},[70],{"categories":2357},[160],{"categories":2359},[],{"categories":2361},[],{"categories":2363},[70],{"categories":2365},[],{"categories":2367},[124],{"categories":2369},[70],{"categories":2371},[],{"categories":2373},[138],{"categories":2375},[138],{"categories":2377},[70],{"categories":2379},[163],{"categories":2381},[],{"categories":2383},[70],{"categories":2385},[70],{"categories":2387},[70],{"categories":2389},[163],{"categories":2391},[138],{"categories":2393},[124],{"categories":2395},[],{"categories":2397},[],{"categories":2399},[70],{"categories":2401},[70],{"categories":2403},[124],{"categories":2405},[124],{"categories":2407},[376],{"categories":2409},[138],{"categories":2411},[138],{"categories":2413},[124],{"categories":2415},[160],{"categories":2417},[160],{"categories":2419},[124],{"categories":2421},[124],{"categories":2423},[70],{"categories":2425},[114],{"categories":2427},[2238],{"categories":2429},[127],{"categories":2431},[70,282],{"categories":2433},[163],{"categories":2435},[],{"categories":2437},[212],{"categories":2439},[124],{"categories":2441},[138],{"categories":2443},[114],{"categories":2445},[70],{"categories":2447},[124],{"categories":2449},[2450],"The Designer's Role & Craft",{"categories":2452},[212],{"categories":2454},[],{"categories":2456},[124],{"categories":2458},[70],{"categories":2460},[124],{"categories":2462},[124],{"categories":2464},[70],{"categories":2466},[241],{"categories":2468},[70],{"categories":2470},[138],{"categories":2472},[70],{"categories":2474},[212],{"categories":2476},[70],{"categories":2478},[],{"categories":2480},[124],{"categories":2482},[212],{"categories":2484},[127],{"categories":2486},[70],{"categories":2488},[70],{"categories":2490},[70],{"categories":2492},[2493],"AI UX Patterns",{"categories":2495},[124],{"categories":2497},[124],{"categories":2499},[124],{"categories":2501},[124],{"categories":2503},[241],{"categories":2505},[163],{"categories":2507},[70],{"categories":2509},[124],{"categories":2511},[70],{"categories":2513},[1235],{"categories":2515},[],{"categories":2517},[241],{"categories":2519},[124],{"categories":2521},[160],{"categories":2523},[138],{"categories":2525},[70],{"categories":2527},[124],{"categories":2529},[],{"categories":2531},[],{"categories":2533},[70],{"categories":2535},[70],{"categories":2537},[124],{"categories":2539},[70],{"categories":2541},[124],{"categories":2543},[376],{"categories":2545},[212],{"categories":2547},[70],{"categories":2549},[160],{"categories":2551},[138],{"categories":2553},[70],{"categories":2555},[124],{"categories":2557},[124],{"categories":2559},[],{"categories":2561},[70],{"categories":2563},[],{"categories":2565},[70],{"categories":2567},[],{"categories":2569},[70],{"categories":2571},[70],{"categories":2573},[70],{"categories":2575},[124],{"categories":2577},[138],{"categories":2579},[],{"categories":2581},[],{"categories":2583},[163],{"categories":2585},[149],{"categories":2587},[70],{"categories":2589},[70],{"categories":2591},[70],{"categories":2593},[163],{"categories":2595},[70],{"categories":2597},[70],{"categories":2599},[160],{"categories":2601},[70],{"categories":2603},[70],{"categories":2605},[70],{"categories":2607},[124],{"categories":2609},[70],{"categories":2611},[124],{"categories":2613},[70],{"categories":2615},[70],{"categories":2617},[70],{"categories":2619},[124],{"categories":2621},[],{"categories":2623},[70],{"categories":2625},[],{"categories":2627},[70],{"categories":2629},[70],{"categories":2631},[282],{"categories":2633},[70],{"categories":2635},[],{"categories":2637},[],{"categories":2639},[212],{"categories":2641},[910],{"categories":2643},[124],{"categories":2645},[114],{"categories":2647},[2450],{"categories":2649},[],{"categories":2651},[],{"categories":2653},[70],{"categories":2655},[],{"categories":2657},[],{"categories":2659},[138],{"categories":2661},[160],{"categories":2663},[241],{"categories":2665},[124],{"categories":2667},[119],{"categories":2669},[70],{"categories":2671},[70],{"categories":2673},[119],{"categories":2675},[],{"categories":2677},[212],{"categories":2679},[127],{"categories":2681},[70],{"categories":2683},[70],{"categories":2685},[124],{"categories":2687},[119],{"categories":2689},[70],{"categories":2691},[70],{"categories":2693},[114],{"categories":2695},[70],{"categories":2697},[70],{"categories":2699},[],{"categories":2701},[114],{"categories":2703},[70],{"categories":2705},[241],{"categories":2707},[124],{"categories":2709},[160],{"categories":2711},[70],{"categories":2713},[138],{"categories":2715},[70],{"categories":2717},[70],{"categories":2719},[119],{"categories":2721},[70],{"categories":2723},[70],{"categories":2725},[70],{"categories":2727},[124],{"categories":2729},[70],{"categories":2731},[],{"categories":2733},[70],{"categories":2735},[138],{"categories":2737},[114],{"categories":2739},[70],{"categories":2741},[70],{"categories":2743},[70],{"categories":2745},[],{"categories":2747},[70],{"categories":2749},[455],{"categories":2751},[124],{"categories":2753},[119],{"categories":2755},[160],{"categories":2757},[70],{"categories":2759},[70],{"categories":2761},[],{"categories":2763},[119],{"categories":2765},[119],{"categories":2767},[70],{"categories":2769},[70],{"categories":2771},[127],{"categories":2773},[70],{"categories":2775},[70],{"categories":2777},[70],{"categories":2779},[70],{"categories":2781},[138],{"categories":2783},[138],{"categories":2785},[70],{"categories":2787},[],{"categories":2789},[138],{"categories":2791},[70],{"categories":2793},[138],{"categories":2795},[124],{"categories":2797},[560],{"categories":2799},[],{"categories":2801},[],{"categories":2803},[70],{"categories":2805},[160],{"categories":2807},[],{"categories":2809},[282],{"categories":2811},[70],{"categories":2813},[70],{"categories":2815},[70],{"categories":2817},[212],{"categories":2819},[872],{"categories":2821},[],{"categories":2823},[70],{"categories":2825},[70],{"categories":2827},[70],{"categories":2829},[138],{"categories":2831},[70],{"categories":2833},[70],{"categories":2835},[70,282],{"categories":2837},[70],{"categories":2839},[70],{"categories":2841},[212],{"categories":2843},[124],{"categories":2845},[],{"categories":2847},[124],{"categories":2849},[124],{"categories":2851},[70],{"categories":2853},[70],{"categories":2855},[70],{"categories":2857},[70],{"categories":2859},[163],{"categories":2861},[70],{"categories":2863},[2493],{"categories":2865},[114],{"categories":2867},[163],{"categories":2869},[114],{"categories":2871},[138],{"categories":2873},[212],{"categories":2875},[124],{"categories":2877},[70],{"categories":2879},[],{"categories":2881},[119],{"categories":2883},[70],{"categories":2885},[70],{"categories":2887},[160],{"categories":2889},[70],{"categories":2891},[70],{"categories":2893},[70],{"categories":2895},[124],{"categories":2897},[70],{"categories":2899},[70],{"categories":2901},[70],{"categories":2903},[119],{"categories":2905},[],{"categories":2907},[282],{"categories":2909},[70],{"categories":2911},[376],{"categories":2913},[212],{"categories":2915},[212],{"categories":2917},[138],{"categories":2919},[124],{"categories":2921},[70],{"categories":2923},[119],{"categories":2925},[160],{"categories":2927},[70],{"categories":2929},[70],{"categories":2931},[70],{"categories":2933},[212],{"categories":2935},[124],{"categories":2937},[124],{"categories":2939},[70],{"categories":2941},[70],{"categories":2943},[514],{"categories":2945},[124],{"categories":2947},[],{"categories":2949},[70],{"categories":2951},[70],{"categories":2953},[70],{"categories":2955},[],{"categories":2957},[],{"categories":2959},[70],{"categories":2961},[70],{"categories":2963},[124],{"categories":2965},[70],{"categories":2967},[70],{"categories":2969},[70],{"categories":2971},[138],{"categories":2973},[70],{"categories":2975},[70],{"categories":2977},[124],{"categories":2979},[70],{"categories":2981},[70],{"categories":2983},[70],{"categories":2985},[70],{"categories":2987},[70],{"categories":2989},[],{"categories":2991},[138],{"categories":2993},[163],{"categories":2995},[70],{"categories":2997},[124],{"categories":2999},[124],{"categories":3001},[70],{"categories":3003},[70],{"categories":3005},[],{"categories":3007},[],{"categories":3009},[70],{"categories":3011},[70],{"categories":3013},[70],{"categories":3015},[160],{"categories":3017},[163],{"categories":3019},[],{"categories":3021},[70],{"categories":3023},[212],{"categories":3025},[70],{"categories":3027},[282],{"categories":3029},[1797],{"categories":3031},[160],{"categories":3033},[138],{"categories":3035},[70],{"categories":3037},[138],{"categories":3039},[138],{"categories":3041},[70],{"categories":3043},[70],{"categories":3045},[138],{"categories":3047},[160],{"categories":3049},[160],{"categories":3051},[282],{"categories":3053},[124],{"categories":3055},[],{"categories":3057},[160],{"categories":3059},[70],{"categories":3061},[124],{"categories":3063},[114],{"categories":3065},[138],{"categories":3067},[70],{"categories":3069},[160],{"categories":3071},[],{"categories":3073},[70],{"categories":3075},[138],{"categories":3077},[138],{"categories":3079},[163],{"categories":3081},[70],{"categories":3083},[160],{"categories":3085},[70],{"categories":3087},[138],{"categories":3089},[124],{"categories":3091},[124],{"categories":3093},[160],{"categories":3095},[124],{"categories":3097},[282],{"categories":3099},[124],{"categories":3101},[70],{"categories":3103},[70],{"categories":3105},[70],{"categories":3107},[70],{"categories":3109},[138],{"categories":3111},[70],{"categories":3113},[],{"categories":3115},[124],{"categories":3117},[119],{"categories":3119},[138],{"categories":3121},[],{"categories":3123},[],{"categories":3125},[70],{"categories":3127},[124],{"categories":3129},[70],{"categories":3131},[70],{"categories":3133},[3134],"Frameworks & Tooling",{"categories":3136},[70],{"categories":3138},[70],{"categories":3140},[138],{"categories":3142},[70],{"categories":3144},[70],{"categories":3146},[],{"categories":3148},[163],{"categories":3150},[163],{"categories":3152},[114],{"categories":3154},[70],{"categories":3156},[124],{"categories":3158},[70],{"categories":3160},[212],{"categories":3162},[],{"categories":3164},[1797],{"categories":3166},[70],{"categories":3168},[138],{"categories":3170},[70],{"categories":3172},[282],{"categories":3174},[282],{"categories":3176},[],{"categories":3178},[124],{"categories":3180},[124],{"categories":3182},[70],{"categories":3184},[70],{"categories":3186},[160],{"categories":3188},[124],{"categories":3190},[160],{"categories":3192},[70],{"categories":3194},[124],{"categories":3196},[],{"categories":3198},[212],{"categories":3200},[70],{"categories":3202},[70],{"categories":3204},[],{"categories":3206},[70],{"categories":3208},[124],{"categories":3210},[70],{"categories":3212},[70],{"categories":3214},[70],{"categories":3216},[],{"categories":3218},[138],{"categories":3220},[70],{"categories":3222},[138],{"categories":3224},[282],{"categories":3226},[70],{"categories":3228},[70],{"categories":3230},[70],{"categories":3232},[138],{"categories":3234},[119],{"categories":3236},[70],{"categories":3238},[1797],{"categories":3240},[],{"categories":3242},[124],{"categories":3244},[114],{"categories":3246},[70],{"categories":3248},[114],{"categories":3250},[70],{"categories":3252},[],{"categories":3254},[124],{"categories":3256},[70],{"categories":3258},[70],{"categories":3260},[3261],"AI Design Tooling",{"categories":3263},[212],{"categories":3265},[70],{"categories":3267},[70],{"categories":3269},[138],{"categories":3271},[212],{"categories":3273},[70],{"categories":3275},[70],{"categories":3277},[138],{"categories":3279},[160],{"categories":3281},[127],{"categories":3283},[138],{"categories":3285},[70],{"categories":3287},[70],{"categories":3289},[70],{"categories":3291},[124],{"categories":3293},[70],{"categories":3295},[],{"categories":3297},[124],{"categories":3299},[70],{"categories":3301},[70],{"categories":3303},[124],{"categories":3305},[70],{"categories":3307},[70],{"categories":3309},[70],{"categories":3311},[124],{"categories":3313},[],{"categories":3315},[124],{"categories":3317},[3134],{"categories":3319},[70],{"categories":3321},[70],{"categories":3323},[124],{"categories":3325},[124],{"categories":3327},[138],{"categories":3329},[138],{"categories":3331},[70],{"categories":3333},[],{"categories":3335},[138],{"categories":3337},[70],{"categories":3339},[70],{"categories":3341},[124],{"categories":3343},[119],{"categories":3345},[70],{"categories":3347},[],{"categories":3349},[70],{"categories":3351},[70],{"categories":3353},[2238],{"categories":3355},[],{"categories":3357},[70],{"categories":3359},[70],{"categories":3361},[70],{"categories":3363},[70],{"categories":3365},[212],{"categories":3367},[70],{"categories":3369},[],{"categories":3371},[70],{"categories":3373},[70],{"categories":3375},[70],{"categories":3377},[70],{"categories":3379},[241],{"categories":3381},[160],{"categories":3383},[70],{"categories":3385},[70],{"categories":3387},[1797],{"categories":3389},[114],{"categories":3391},[70],{"categories":3393},[70],{"categories":3395},[163],{"categories":3397},[70],{"categories":3399},[70],{"categories":3401},[160],{"categories":3403},[124],{"categories":3405},[],{"categories":3407},[70],{"categories":3409},[70],{"categories":3411},[212],{"categories":3413},[70],{"categories":3415},[241],{"categories":3417},[124],{"categories":3419},[70],{"categories":3421},[124],{"categories":3423},[],{"categories":3425},[],{"categories":3427},[],{"categories":3429},[114],{"categories":3431},[160],{"categories":3433},[124],{"categories":3435},[70],{"categories":3437},[70],{"categories":3439},[70],{"categories":3441},[70],{"categories":3443},[399],{"categories":3445},[212],{"categories":3447},[124],{"categories":3449},[70],{"categories":3451},[],{"categories":3453},[124],{"categories":3455},[124],{"categories":3457},[],{"categories":3459},[70],{"categories":3461},[124],{"categories":3463},[70],{"categories":3465},[],{"categories":3467},[70],{"categories":3469},[70],{"categories":3471},[70],{"categories":3473},[160],{"categories":3475},[212],{"categories":3477},[124],{"categories":3479},[212],{"categories":3481},[124],{"categories":3483},[70],{"categories":3485},[119],{"categories":3487},[],{"categories":3489},[],{"categories":3491},[70],{"categories":3493},[70],{"categories":3495},[70],{"categories":3497},[114],{"categories":3499},[124],{"categories":3501},[160],{"categories":3503},[],{"categories":3505},[212],{"categories":3507},[],{"categories":3509},[138],{"categories":3511},[70],{"categories":3513},[138],{"categories":3515},[212],{"categories":3517},[138],{"categories":3519},[70],{"categories":3521},[],{"categories":3523},[70],{"categories":3525},[70],{"categories":3527},[],{"categories":3529},[70],{"categories":3531},[70],{"categories":3533},[241],{"categories":3535},[70],{"categories":3537},[70],{"categories":3539},[282],{"categories":3541},[138],{"categories":3543},[70],{"categories":3545},[],{"categories":3547},[124],{"categories":3549},[70],{"categories":3551},[114],{"categories":3553},[514],{"categories":3555},[70],{"categories":3557},[70],{"categories":3559},[124],{"categories":3561},[70],{"categories":3563},[124],{"categories":3565},[70],{"categories":3567},[70],{"categories":3569},[70],{"categories":3571},[70],{"categories":3573},[],{"categories":3575},[70],{"categories":3577},[114],{"categories":3579},[70],{"categories":3581},[119],{"categories":3583},[138],{"categories":3585},[212],{"categories":3587},[],{"categories":3589},[70],{"categories":3591},[],{"categories":3593},[124],{"categories":3595},[70],{"categories":3597},[],{"categories":3599},[124],{"categories":3601},[70],{"categories":3603},[138],{"categories":3605},[212],{"categories":3607},[160],{"categories":3609},[70],{"categories":3611},[160],{"categories":3613},[124],{"categories":3615},[212],{"categories":3617},[70],{"categories":3619},[],{"categories":3621},[70],{"categories":3623},[149],{"categories":3625},[124],{"categories":3627},[70],{"categories":3629},[212],{"categories":3631},[160],{"categories":3633},[119],{"categories":3635},[138],{"categories":3637},[70],{"categories":3639},[70],{"categories":3641},[70],{"categories":3643},[70],{"categories":3645},[160],{"categories":3647},[241],{"categories":3649},[],{"categories":3651},[],{"categories":3653},[163],{"categories":3655},[455],{"categories":3657},[70],{"categories":3659},[124],{"categories":3661},[70,138],{"categories":3663},[160],{"categories":3665},[70],{"categories":3667},[70],{"categories":3669},[70],{"categories":3671},[70],{"categories":3673},[70],{"categories":3675},[70],{"categories":3677},[70],{"categories":3679},[124],{"categories":3681},[70],{"categories":3683},[124],{"categories":3685},[70],{"categories":3687},[70],{"categories":3689},[70],{"categories":3691},[],{"categories":3693},[70],{"categories":3695},[1235],{"categories":3697},[138],{"categories":3699},[212],{"categories":3701},[70],{"categories":3703},[70],{"categories":3705},[70],{"categories":3707},[163],{"categories":3709},[124],{"categories":3711},[241],{"categories":3713},[282],{"categories":3715},[],{"categories":3717},[138],{"categories":3719},[70],{"categories":3721},[119],{"categories":3723},[124],{"categories":3725},[114],{"categories":3727},[124],{"categories":3729},[70],{"categories":3731},[124],{"categories":3733},[124],{"categories":3735},[127],{"categories":3737},[138],{"categories":3739},[70],{"categories":3741},[70],{"categories":3743},[],{"categories":3745},[],{"categories":3747},[],{"categories":3749},[282],{"categories":3751},[70],{"categories":3753},[160],{"categories":3755},[70],{"categories":3757},[70],{"categories":3759},[70],{"categories":3761},[70],{"categories":3763},[],{"categories":3765},[70],{"categories":3767},[163],{"categories":3769},[119],{"categories":3771},[124],{"categories":3773},[70],{"categories":3775},[],{"categories":3777},[70],{"categories":3779},[124],{"categories":3781},[70],{"categories":3783},[282],{"categories":3785},[],{"categories":3787},[212],{"categories":3789},[212],{"categories":3791},[70],{"categories":3793},[124],{"categories":3795},[],{"categories":3797},[138],{"categories":3799},[70],{"categories":3801},[212],{"categories":3803},[70],{"categories":3805},[119],{"categories":3807},[124],{"categories":3809},[70],{"categories":3811},[],{"categories":3813},[160],{"categories":3815},[70],{"categories":3817},[70],{"categories":3819},[70],{"categories":3821},[212],{"categories":3823},[124],{"categories":3825},[160],{"categories":3827},[],{"categories":3829},[124],{"categories":3831},[119],{"categories":3833},[124],{"categories":3835},[212],{"categories":3837},[70],{"categories":3839},[70],{"categories":3841},[70],{"categories":3843},[455],{"categories":3845},[70],{"categories":3847},[124],{"categories":3849},[],{"categories":3851},[70],{"categories":3853},[70],{"categories":3855},[282],{"categories":3857},[160],{"categories":3859},[163],{"categories":3861},[560],{"categories":3863},[163],{"categories":3865},[163],{"categories":3867},[70],{"categories":3869},[],{"categories":3871},[],{"categories":3873},[],{"categories":3875},[124],{"categories":3877},[70],{"categories":3879},[124],{"categories":3881},[124],{"categories":3883},[138],{"categories":3885},[70],{"categories":3887},[432],{"categories":3889},[138],{"categories":3891},[124],{"categories":3893},[70],{"categories":3895},[70],{"categories":3897},[70],{"categories":3899},[70],{"categories":3901},[70],{"categories":3903},[124],{"categories":3905},[70],{"categories":3907},[],{"categories":3909},[],{"categories":3911},[70],{"categories":3913},[],{"categories":3915},[70],{"categories":3917},[124],{"categories":3919},[212],{"categories":3921},[70],{"categories":3923},[70],{"categories":3925},[],{"categories":3927},[124],{"categories":3929},[70],{"categories":3931},[70],{"categories":3933},[127],{"categories":3935},[70],{"categories":3937},[212],{"categories":3939},[70],{"categories":3941},[124],{"categories":3943},[119],{"categories":3945},[70],{"categories":3947},[70],{"categories":3949},[241],{"categories":3951},[124],{"categories":3953},[70],{"categories":3955},[70],{"categories":3957},[872],{"categories":3959},[70],{"categories":3961},[124],{"categories":3963},[70],{"categories":3965},[138],{"categories":3967},[70],{"categories":3969},[514],{"categories":3971},[212],{"categories":3973},[],{"categories":3975},[70],{"categories":3977},[70],{"categories":3979},[160],{"categories":3981},[455],{"categories":3983},[124],{"categories":3985},[70],{"categories":3987},[],{"categories":3989},[160],{"categories":3991},[376],{"categories":3993},[124],{"categories":3995},[124],{"categories":3997},[124],{"categories":3999},[70],{"categories":4001},[70],{"categories":4003},[124],{"categories":4005},[],{"categories":4007},[119],{"categories":4009},[70],{"categories":4011},[119],{"categories":4013},[124],{"categories":4015},[],{"categories":4017},[138],{"categories":4019},[70],{"categories":4021},[70],{"categories":4023},[114],{"categories":4025},[70],{"categories":4027},[160],{"categories":4029},[282],{"categories":4031},[149],{"categories":4033},[124],{"categories":4035},[124],{"categories":4037},[70],{"categories":4039},[70],{"categories":4041},[124],{"categories":4043},[70],{"categories":4045},[114],{"categories":4047},[],{"categories":4049},[124],{"categories":4051},[70],{"categories":4053},[70],{"categories":4055},[70],{"categories":4057},[124],{"categories":4059},[70],{"categories":4061},[],{"categories":4063},[70],{"categories":4065},[],{"categories":4067},[212],{"categories":4069},[124],{"categories":4071},[70,119],{"categories":4073},[124],{"categories":4075},[70],{"categories":4077},[],{"categories":4079},[114],{"categories":4081},[163],{"categories":4083},[119],{"categories":4085},[70],{"categories":4087},[138],{"categories":4089},[70],{"categories":4091},[70],{"categories":4093},[124],{"categories":4095},[70],{"categories":4097},[70],{"categories":4099},[70],{"categories":4101},[160],{"categories":4103},[1235],{"categories":4105},[124],{"categories":4107},[70],{"categories":4109},[],{"categories":4111},[],{"categories":4113},[70],{"categories":4115},[124],{"categories":4117},[70],{"categories":4119},[70],{"categories":4121},[282],{"categories":4123},[],{"categories":4125},[70],{"categories":4127},[124],{"categories":4129},[149],{"categories":4131},[124],{"categories":4133},[455],{"categories":4135},[],{"categories":4137},[399],{"categories":4139},[124],{"categories":4141},[70],{"categories":4143},[70],{"categories":4145},[241],{"categories":4147},[124],{"categories":4149},[70],{"categories":4151},[163],{"categories":4153},[127],{"categories":4155},[124],{"categories":4157},[70],{"categories":4159},[455],{"categories":4161},[70],{"categories":4163},[282],{"categories":4165},[119],{"categories":4167},[],{"categories":4169},[70],{"categories":4171},[70],{"categories":4173},[241],{"categories":4175},[212],{"categories":4177},[70],{"categories":4179},[70],{"categories":4181},[70],{"categories":4183},[],{"categories":4185},[241],{"categories":4187},[160],{"categories":4189},[70],{"categories":4191},[70],{"categories":4193},[70],{"categories":4195},[560],{"categories":4197},[114],{"categories":4199},[70],{"categories":4201},[127],{"categories":4203},[70],{"categories":4205},[],{"categories":4207},[],{"categories":4209},[212],{"categories":4211},[70],{"categories":4213},[163],{"categories":4215},[241],{"categories":4217},[124],{"categories":4219},[70],{"categories":4221},[70],{"categories":4223},[241],{"categories":4225},[160],{"categories":4227},[70],{"categories":4229},[],{"categories":4231},[70],{"categories":4233},[70],{"categories":4235},[],{"categories":4237},[70],{"categories":4239},[70],{"categories":4241},[585],{"categories":4243},[70],{"categories":4245},[70],{"categories":4247},[124],{"categories":4249},[138],{"categories":4251},[455],{"categories":4253},[70],{"categories":4255},[70],{"categories":4257},[70],{"categories":4259},[],{"categories":4261},[70,138],{"categories":4263},[160],{"categories":4265},[124],{"categories":4267},[138],{"categories":4269},[124],{"categories":4271},[910],{"categories":4273},[138],{"categories":4275},[138],{"categories":4277},[124],{"categories":4279},[70],{"categories":4281},[114],{"categories":4283},[],{"categories":4285},[],{"categories":4287},[124],{"categories":4289},[70],{"categories":4291},[138],{"categories":4293},[70],{"categories":4295},[114],{"categories":4297},[138],{"categories":4299},[138],{"categories":4301},[70],{"categories":4303},[241],{"categories":4305},[70],{"categories":4307},[138],{"categories":4309},[70],{"categories":4311},[],{"categories":4313},[70],{"categories":4315},[70],{"categories":4317},[212,70],{"categories":4319},[282],{"categories":4321},[114],{"categories":4323},[70],{"categories":4325},[],{"categories":4327},[70],{"categories":4329},[70],{"categories":4331},[119],{"categories":4333},[70],{"categories":4335},[119],{"categories":4337},[70],{"categories":4339},[70],{"categories":4341},[376],{"categories":4343},[70],{"categories":4345},[119],{"categories":4347},[138],{"categories":4349},[163],{"categories":4351},[124],{"categories":4353},[70],{"categories":4355},[138],{"categories":4357},[70],{"categories":4359},[70],{"categories":4361},[160],{"categories":4363},[241],{"categories":4365},[212],{"categories":4367},[70],{"categories":4369},[70],{"categories":4371},[70],{"categories":4373},[70],{"categories":4375},[114],{"categories":4377},[70],{"categories":4379},[124],{"categories":4381},[124],{"categories":4383},[138],{"categories":4385},[160],{"categories":4387},[138],{"categories":4389},[138],{"categories":4391},[70],{"categories":4393},[70],{"categories":4395},[],{"categories":4397},[],{"categories":4399},[163],{"categories":4401},[70],{"categories":4403},[138],{"categories":4405},[70],{"categories":4407},[212],{"categories":4409},[455],{"categories":4411},[399],{"categories":4413},[376],{"categories":4415},[70],{"categories":4417},[70],{"categories":4419},[70],{"categories":4421},[163],{"categories":4423},[70],{"categories":4425},[70],{"categories":4427},[70],{"categories":4429},[70],{"categories":4431},[70],{"categories":4433},[70],{"categories":4435},[70],{"categories":4437},[124],{"categories":4439},[114],{"categories":4441},[124],{"categories":4443},[70,119],{"categories":4445},[],{"categories":4447},[212],{"categories":4449},[],{"categories":4451},[127],{"categories":4453},[70],{"categories":4455},[160],{"categories":4457},[114],{"categories":4459},[70],{"categories":4461},[114],{"categories":4463},[124],{"categories":4465},[163],{"categories":4467},[124],{"categories":4469},[127],{"categories":4471},[124],{"categories":4473},[70],{"categories":4475},[70],{"categories":4477},[119],{"categories":4479},[124],{"categories":4481},[138],{"categories":4483},[241],{"categories":4485},[70],{"categories":4487},[70],{"categories":4489},[],{"categories":4491},[160],{"categories":4493},[70],{"categories":4495},[70],{"categories":4497},[70],{"categories":4499},[70],{"categories":4501},[70],{"categories":4503},[70],{"categories":4505},[138],{"categories":4507},[160],{"categories":4509},[138],{"categories":4511},[138],{"categories":4513},[70],{"categories":4515},[70],{"categories":4517},[70],{"categories":4519},[70],{"categories":4521},[399],{"categories":4523},[70],{"categories":4525},[124],{"categories":4527},[160],{"categories":4529},[70],{"categories":4531},[70],{"categories":4533},[70],{"categories":4535},[124],{"categories":4537},[70],{"categories":4539},[70],{"categories":4541},[70],{"categories":4543},[3134],{"categories":4545},[4546],"Clinical AI",{"categories":4548},[212],{"categories":4550},[70],{"categories":4552},[70],{"categories":4554},[70],{"categories":4556},[70],{"categories":4558},[282],{"categories":4560},[2493],{"categories":4562},[70],{"categories":4564},[127],{"categories":4566},[212],{"categories":4568},[70],{"categories":4570},[124],{"categories":4572},[70],{"categories":4574},[70],{"categories":4576},[160],{"categories":4578},[70],{"categories":4580},[124],{"categories":4582},[138],{"categories":4584},[241],{"categories":4586},[70],{"categories":4588},[70],{"categories":4590},[119],{"categories":4592},[70],{"categories":4594},[70],{"categories":4596},[514],{"categories":4598},[70],{"categories":4600},[],{"categories":4602},[124],{"categories":4604},[70],{"categories":4606},[138],{"categories":4608},[114],{"categories":4610},[70],{"categories":4612},[],{"categories":4614},[],{"categories":4616},[70],{"categories":4618},[],{"categories":4620},[119],{"categories":4622},[70],{"categories":4624},[70],{"categories":4626},[124],{"categories":4628},[70],{"categories":4630},[160],{"categories":4632},[160],{"categories":4634},[160],{"categories":4636},[160],{"categories":4638},[],{"categories":4640},[114],{"categories":4642},[124],{"categories":4644},[160],{"categories":4646},[70],{"categories":4648},[585],{"categories":4650},[127],{"categories":4652},[124],{"categories":4654},[70],{"categories":4656},[114],{"categories":4658},[70],{"categories":4660},[124],{"categories":4662},[70],{"categories":4664},[70],{"categories":4666},[70],{"categories":4668},[70,124],{"categories":4670},[124],{"categories":4672},[282],{"categories":4674},[160],{"categories":4676},[124],{"categories":4678},[160],{"categories":4680},[124],{"categories":4682},[70],{"categories":4684},[],{"categories":4686},[160],{"categories":4688},[241],{"categories":4690},[114],{"categories":4692},[70],{"categories":4694},[70],{"categories":4696},[],{"categories":4698},[138],{"categories":4700},[],{"categories":4702},[114],{"categories":4704},[124],{"categories":4706},[160],{"categories":4708},[70],{"categories":4710},[160],{"categories":4712},[114],{"categories":4714},[160],{"categories":4716},[160],{"categories":4718},[],{"categories":4720},[119],{"categories":4722},[124],{"categories":4724},[160],{"categories":4726},[160],{"categories":4728},[160],{"categories":4730},[160],{"categories":4732},[160],{"categories":4734},[160],{"categories":4736},[160],{"categories":4738},[160],{"categories":4740},[160],{"categories":4742},[160],{"categories":4744},[163],{"categories":4746},[114],{"categories":4748},[70],{"categories":4750},[70],{"categories":4752},[124],{"categories":4754},[124],{"categories":4756},[],{"categories":4758},[70],{"categories":4760},[70,114],{"categories":4762},[],{"categories":4764},[124],{"categories":4766},[70],{"categories":4768},[160],{"categories":4770},[124],{"categories":4772},[910],{"categories":4774},[70],{"categories":4776},[70],{"categories":4778},[70],{"categories":4780},[70],{"categories":4782},[70],{"categories":4784},[376],{"categories":4786},[70],{"categories":4788},[70],{"categories":4790},[124],{"categories":4792},[70],{"categories":4794},[70],{"categories":4796},[119],{"categories":4798},[127],{"categories":4800},[124],{"categories":4802},[124],{"categories":4804},[],{"categories":4806},[124],{"categories":4808},[212],{"categories":4810},[160],{"categories":4812},[70],{"categories":4814},[],{"categories":4816},[127],{"categories":4818},[],{"categories":4820},[138],{"categories":4822},[70],{"categories":4824},[124],{"categories":4826},[212],{"categories":4828},[70],{"categories":4830},[],{"categories":4832},[70],{"categories":4834},[70],{"categories":4836},[],{"categories":4838},[241],{"categories":4840},[70],{"categories":4842},[124],{"categories":4844},[],{"categories":4846},[],{"categories":4848},[160],{"categories":4850},[114],{"categories":4852},[70],{"categories":4854},[70],{"categories":4856},[119],{"categories":4858},[70],{"categories":4860},[70],{"categories":4862},[124],{"categories":4864},[70],{"categories":4866},[119],{"categories":4868},[119],{"categories":4870},[212],{"categories":4872},[],{"categories":4874},[70],{"categories":4876},[160],{"categories":4878},[],{"categories":4880},[70],{"categories":4882},[70],{"categories":4884},[212],{"categories":4886},[70],{"categories":4888},[70],{"categories":4890},[241],{"categories":4892},[70],{"categories":4894},[282],{"categories":4896},[],{"categories":4898},[124],{"categories":4900},[70],{"categories":4902},[241],{"categories":4904},[138],{"categories":4906},[],{"categories":4908},[70],{"categories":4910},[],{"categories":4912},[124],{"categories":4914},[212],{"categories":4916},[138],{"categories":4918},[],{"categories":4920},[3134],{"categories":4922},[119],{"categories":4924},[114],{"categories":4926},[70],{"categories":4928},[163],{"categories":4930},[124],{"categories":4932},[212],{"categories":4934},[70],{"categories":4936},[138],{"categories":4938},[],{"categories":4940},[],{"categories":4942},[70],{"categories":4944},[114],{"categories":4946},[70],{"categories":4948},[241],{"categories":4950},[],{"categories":4952},[124],{"categories":4954},[124],{"categories":4956},[70],{"categories":4958},[124],{"categories":4960},[70],{"categories":4962},[160],{"categories":4964},[138],{"categories":4966},[70],{"categories":4968},[124],{"categories":4970},[127],{"categories":4972},[70],{"categories":4974},[70],{"categories":4976},[70],{"categories":4978},[124],{"categories":4980},[70],{"categories":4982},[127],{"categories":4984},[241],{"categories":4986},[160],{"categories":4988},[],{"categories":4990},[241],{"categories":4992},[70],{"categories":4994},[],{"categories":4996},[138],{"categories":4998},[124],{"categories":5000},[],{"categories":5002},[70],{"categories":5004},[70],{"categories":5006},[70],{"categories":5008},[70],{"categories":5010},[70],{"categories":5012},[124],{"categories":5014},[119],{"categories":5016},[114],{"categories":5018},[124],{"categories":5020},[70],{"categories":5022},[212],{"categories":5024},[138],{"categories":5026},[138],{"categories":5028},[70],{"categories":5030},[163],{"categories":5032},[124],{"categories":5034},[70],{"categories":5036},[70],{"categories":5038},[124],{"categories":5040},[70],{"categories":5042},[70],{"categories":5044},[124],{"categories":5046},[119],{"categories":5048},[70],{"categories":5050},[212],{"categories":5052},[138],{"categories":5054},[124],{"categories":5056},[70],{"categories":5058},[127],{"categories":5060},[70],{"categories":5062},[124],{"categories":5064},[70],{"categories":5066},[70],{"categories":5068},[160],{"categories":5070},[70],{"categories":5072},[],{"categories":5074},[114],{"categories":5076},[70],{"categories":5078},[70],{"categories":5080},[70],{"categories":5082},[138],{"categories":5084},[138],{"categories":5086},[70],{"categories":5088},[138],{"categories":5090},[70],{"categories":5092},[124],{"categories":5094},[70],{"categories":5096},[70],{"categories":5098},[70],{"categories":5100},[70],{"categories":5102},[70],{"categories":5104},[],{"categories":5106},[70],{"categories":5108},[212],{"categories":5110},[124],{"categories":5112},[119],{"categories":5114},[160],{"categories":5116},[70],{"categories":5118},[124],{"categories":5120},[70],{"categories":5122},[124],{"categories":5124},[70],{"categories":5126},[70],{"categories":5128},[212],{"categories":5130},[124],{"categories":5132},[70],{"categories":5134},[241],{"categories":5136},[70],{"categories":5138},[163],{"categories":5140},[70],{"categories":5142},[70],{"categories":5144},[160],{"categories":5146},[70],{"categories":5148},[70],{"categories":5150},[70],{"categories":5152},[70],{"categories":5154},[124],{"categories":5156},[282],{"categories":5158},[70],{"categories":5160},[138],{"categories":5162},[124],{"categories":5164},[163],{"categories":5166},[],{"categories":5168},[124],{"categories":5170},[138],{"categories":5172},[70],{"categories":5174},[70],{"categories":5176},[2331],{"categories":5178},[212],{"categories":5180},[311],{"categories":5182},[70],{"categories":5184},[70],{"categories":5186},[70],{"categories":5188},[70],{"categories":5190},[114],{"categories":5192},[70],{"categories":5194},[70],{"categories":5196},[138],{"categories":5198},[119],{"categories":5200},[70],{"categories":5202},[138],{"categories":5204},[70],{"categories":5206},[],{"categories":5208},[124],{"categories":5210},[124],{"categories":5212},[70],{"categories":5214},[70],{"categories":5216},[70],{"categories":5218},[163],{"categories":5220},[],{"categories":5222},[160],{"categories":5224},[],{"categories":5226},[160],{"categories":5228},[70],{"categories":5230},[70],{"categories":5232},[124],{"categories":5234},[70],{"categories":5236},[124],{"categories":5238},[124],{"categories":5240},[],{"categories":5242},[70],{"categories":5244},[160],{"categories":5246},[70],{"categories":5248},[],{"categories":5250},[70],{"categories":5252},[70],{"categories":5254},[],{"categories":5256},[70],{"categories":5258},[70],{"categories":5260},[212],{"categories":5262},[138],{"categories":5264},[124],{"categories":5266},[70],{"categories":5268},[70],{"categories":5270},[70],{"categories":5272},[70],{"categories":5274},[241],{"categories":5276},[70],{"categories":5278},[70],{"categories":5280},[70],{"categories":5282},[114],{"categories":5284},[70],{"categories":5286},[70],{"categories":5288},[],{"categories":5290},[70],{"categories":5292},[70],{"categories":5294},[70],{"categories":5296},[],{"categories":5298},[114],{"categories":5300},[70],{"categories":5302},[70],{"categories":5304},[160],{"categories":5306},[138],{"categories":5308},[127],{"categories":5310},[124],{"categories":5312},[455],{"categories":5314},[70],{"categories":5316},[70],{"categories":5318},[70],{"categories":5320},[138],{"categories":5322},[160],{"categories":5324},[212],{"categories":5326},[70],{"categories":5328},[70],{"categories":5330},[70],{"categories":5332},[70],{"categories":5334},[160],{"categories":5336},[70],{"categories":5338},[212],{"categories":5340},[70],{"categories":5342},[70],{"categories":5344},[160],{"categories":5346},[212],{"categories":5348},[70],{"categories":5350},[160],{"categories":5352},[70],{"categories":5354},[124],{"categories":5356},[124],{"categories":5358},[124],{"categories":5360},[138],{"categories":5362},[160],{"categories":5364},[124],{"categories":5366},[124],{"categories":5368},[70],{"categories":5370},[138],{"categories":5372},[212],{"categories":5374},[70],{"categories":5376},[70],{"categories":5378},[124],{"categories":5380},[70],{"categories":5382},[],{"categories":5384},[124],{"categories":5386},[],{"categories":5388},[70],{"categories":5390},[70],{"categories":5392},[],{"categories":5394},[],{"categories":5396},[124],{"categories":5398},[119],{"categories":5400},[124],{"categories":5402},[5403],"Liability & Ethics",{"categories":5405},[70],{"categories":5407},[70],{"categories":5409},[70],{"categories":5411},[124],{"categories":5413},[114],{"categories":5415},[124],{"categories":5417},[119],{"categories":5419},[241],{"categories":5421},[124],{"categories":5423},[70],{"categories":5425},[70],{"categories":5427},[],{"categories":5429},[560],{"categories":5431},[124],{"categories":5433},[],{"categories":5435},[70],{"categories":5437},[114],{"categories":5439},[124],{"categories":5441},[],{"categories":5443},[124],{"categories":5445},[70],{"categories":5447},[70],{"categories":5449},[138],{"categories":5451},[70],{"categories":5453},[160],{"categories":5455},[70],{"categories":5457},[70],{"categories":5459},[127],{"categories":5461},[124],{"categories":5463},[70],{"categories":5465},[70],{"categories":5467},[70],{"categories":5469},[160],{"categories":5471},[124],{"categories":5473},[138],{"categories":5475},[212],{"categories":5477},[114],{"categories":5479},[70],{"categories":5481},[70],{"categories":5483},[70],{"categories":5485},[],{"categories":5487},[124],{"categories":5489},[124],{"categories":5491},[124],{"categories":5493},[455],{"categories":5495},[212],{"categories":5497},[124],{"categories":5499},[282],{"categories":5501},[138],{"categories":5503},[160],{"categories":5505},[70],{"categories":5507},[212],{"categories":5509},[70],{"categories":5511},[114],{"categories":5513},[],{"categories":5515},[124],{"categories":5517},[70],{"categories":5519},[70],{"categories":5521},[70],{"categories":5523},[70],{"categories":5525},[124],{"categories":5527},[70],{"categories":5529},[70],{"categories":5531},[212],{"categories":5533},[],{"categories":5535},[124],{"categories":5537},[127],{"categories":5539},[160],{"categories":5541},[124],{"categories":5543},[119],{"categories":5545},[],{"categories":5547},[70],{"categories":5549},[70],{"categories":5551},[127],{"categories":5553},[70],{"categories":5555},[124],{"categories":5557},[160],{"categories":5559},[114],{"categories":5561},[282],{"categories":5563},[70],{"categories":5565},[70],{"categories":5567},[70],{"categories":5569},[160],{"categories":5571},[119],{"categories":5573},[70],{"categories":5575},[212],{"categories":5577},[160],{"categories":5579},[282],{"categories":5581},[70],{"categories":5583},[124],{"categories":5585},[],{"categories":5587},[514],{"categories":5589},[],{"categories":5591},[70],{"categories":5593},[282],{"categories":5595},[70],{"categories":5597},[163],{"categories":5599},[70],{"categories":5601},[124],{"categories":5603},[124],{"categories":5605},[5606],"Design News & Tools",{"categories":5608},[70],{"categories":5610},[70],{"categories":5612},[160],{"categories":5614},[70],{"categories":5616},[70],{"categories":5618},[114],{"categories":5620},[124],{"categories":5622},[70],{"categories":5624},[212],{"categories":5626},[124],{"categories":5628},[124],{"categories":5630},[212],{"categories":5632},[70],{"categories":5634},[70],{"categories":5636},[455],{"categories":5638},[124],{"categories":5640},[70],{"categories":5642},[70],{"categories":5644},[455],{"categories":5646},[70],{"categories":5648},[241],{"categories":5650},[70],{"categories":5652},[124],{"categories":5654},[],{"categories":5656},[70],{"categories":5658},[70],{"categories":5660},[70],{"categories":5662},[160],{"categories":5664},[70],{"categories":5666},[114],{"categories":5668},[],{"categories":5670},[70],{"categories":5672},[70],{"categories":5674},[70],{"categories":5676},[138],{"categories":5678},[585],{"categories":5680},[138],{"categories":5682},[212],{"categories":5684},[70],{"categories":5686},[70,124],{"categories":5688},[241,119],{"categories":5690},[138],{"categories":5692},[70],{"categories":5694},[70],{"categories":5696},[70],{"categories":5698},[70],{"categories":5700},[],{"categories":5702},[124],{"categories":5704},[70],{"categories":5706},[],{"categories":5708},[70],{"categories":5710},[138],{"categories":5712},[70],{"categories":5714},[138],{"categories":5716},[],{"categories":5718},[124],{"categories":5720},[70],{"categories":5722},[119],{"categories":5724},[70],{"categories":5726},[160],{"categories":5728},[70],{"categories":5730},[],{"categories":5732},[124],{"categories":5734},[70],{"categories":5736},[],{"categories":5738},[212],{"categories":5740},[70],{"categories":5742},[70],{"categories":5744},[124],{"categories":5746},[70],{"categories":5748},[70],{"categories":5750},[114],{"categories":5752},[124],{"categories":5754},[70],{"categories":5756},[],{"categories":5758},[70],{"categories":5760},[282],{"categories":5762},[241],{"categories":5764},[119],{"categories":5766},[119],{"categories":5768},[70],{"categories":5770},[114],{"categories":5772},[114],{"categories":5774},[70],{"categories":5776},[124],{"categories":5778},[70],{"categories":5780},[70],{"categories":5782},[70],{"categories":5784},[70],{"categories":5786},[138],{"categories":5788},[70],{"categories":5790},[114],{"categories":5792},[70],{"categories":5794},[70],{"categories":5796},[124],{"categories":5798},[70],{"categories":5800},[241],{"categories":5802},[70],{"categories":5804},[160],{"categories":5806},[70],{"categories":5808},[70],{"categories":5810},[124],{"categories":5812},[127],{"categories":5814},[70],{"categories":5816},[70],{"categories":5818},[124],{"categories":5820},[],{"categories":5822},[138],{"categories":5824},[],{"categories":5826},[138],{"categories":5828},[124],{"categories":5830},[114],{"categories":5832},[70],{"categories":5834},[],{"categories":5836},[163],{"categories":5838},[282],{"categories":5840},[70],{"categories":5842},[138],{"categories":5844},[70],{"categories":5846},[],{"categories":5848},[160],{"categories":5850},[124],{"categories":5852},[138],{"categories":5854},[212],{"categories":5856},[119],{"categories":5858},[70],{"categories":5860},[70],{"categories":5862},[124],{"categories":5864},[138],{"categories":5866},[124],{"categories":5868},[160],{"categories":5870},[70],{"categories":5872},[127],{"categories":5874},[114],{"categories":5876},[127],{"categories":5878},[160],{"categories":5880},[70],{"categories":5882},[138],{"categories":5884},[70],{"categories":5886},[212],{"categories":5888},[119],{"categories":5890},[70],{"categories":5892},[70],{"categories":5894},[70],{"categories":5896},[70],{"categories":5898},[70],{"categories":5900},[70],{"categories":5902},[124],{"categories":5904},[70],{"categories":5906},[124],{"categories":5908},[70],{"categories":5910},[70],{"categories":5912},[114],{"categories":5914},[70],{"categories":5916},[124],{"categories":5918},[124],{"categories":5920},[212],{"categories":5922},[124],{"categories":5924},[124],{"categories":5926},[70],{"categories":5928},[114],{"categories":5930},[124],{"categories":5932},[212],{"categories":5934},[],{"categories":5936},[70],{"categories":5938},[163],{"categories":5940},[455],{"categories":5942},[70],{"categories":5944},[124],{"categories":5946},[70],{"categories":5948},[70],{"categories":5950},[138],{"categories":5952},[70],{"categories":5954},[],{"categories":5956},[70],{"categories":5958},[124],{"categories":5960},[70],{"categories":5962},[241],{"categories":5964},[70],{"categories":5966},[138],{"categories":5968},[70],{"categories":5970},[160],{"categories":5972},[124],{"categories":5974},[70],{"categories":5976},[241],{"categories":5978},[124],{"categories":5980},[119],{"categories":5982},[119],{"categories":5984},[70],{"categories":5986},[70],{"categories":5988},[70],{"categories":5990},[70],{"categories":5992},[70],{"categories":5994},[70],{"categories":5996},[114],{"categories":5998},[],{"categories":6000},[70],{"categories":6002},[70],{"categories":6004},[124],{"categories":6006},[124],{"categories":6008},[70],{"categories":6010},[70],{"categories":6012},[70],{"categories":6014},[70],{"categories":6016},[70],{"categories":6018},[138],{"categories":6020},[],{"categories":6022},[114],{"categories":6024},[70],{"categories":6026},[70],{"categories":6028},[124],{"categories":6030},[124],{"categories":6032},[],{"categories":6034},[138],{"categories":6036},[138],{"categories":6038},[70],{"categories":6040},[241],{"categories":6042},[119],{"categories":6044},[212],{"categories":6046},[],{"categories":6048},[70],{"categories":6050},[124],{"categories":6052},[114],{"categories":6054},[70],{"categories":6056},[70],{"categories":6058},[138],{"categories":6060},[114],{"categories":6062},[70],{"categories":6064},[70],{"categories":6066},[160],{"categories":6068},[163],{"categories":6070},[70],{"categories":6072},[160],{"categories":6074},[124],{"categories":6076},[70],{"categories":6078},[],{"categories":6080},[160],{"categories":6082},[124],{"categories":6084},[212],{"categories":6086},[163],{"categories":6088},[70],{"categories":6090},[70],{"categories":6092},[],{"categories":6094},[124],{"categories":6096},[124],{"categories":6098},[124],{"categories":6100},[3134],{"categories":6102},[160],{"categories":6104},[70],{"categories":6106},[138],{"categories":6108},[70],{"categories":6110},[70],{"categories":6112},[70],{"categories":6114},[70],{"categories":6116},[70],{"categories":6118},[119],{"categories":6120},[70],{"categories":6122},[114],{"categories":6124},[1797],{"categories":6126},[282],{"categories":6128},[114],{"categories":6130},[],{"categories":6132},[70],{"categories":6134},[],{"categories":6136},[160],{"categories":6138},[124],{"categories":6140},[212],{"categories":6142},[70],{"categories":6144},[70],{"categories":6146},[70],{"categories":6148},[160],{"categories":6150},[],{"categories":6152},[124],{"categories":6154},[70],{"categories":6156},[124],{"categories":6158},[124],{"categories":6160},[],{"categories":6162},[70],{"categories":6164},[],{"categories":6166},[160],{"categories":6168},[114],{"categories":6170},[212],{"categories":6172},[70],{"categories":6174},[124],{"categories":6176},[160],{"categories":6178},[70],{"categories":6180},[160],{"categories":6182},[],{"categories":6184},[160],{"categories":6186},[70],{"categories":6188},[114],{"categories":6190},[455],{"categories":6192},[124],{"categories":6194},[70],{"categories":6196},[],{"categories":6198},[138],{"categories":6200},[124],{"categories":6202},[127],{"categories":6204},[124],{"categories":6206},[114],{"categories":6208},[70],{"categories":6210},[70],{"categories":6212},[],{"categories":6214},[],{"categories":6216},[],{"categories":6218},[212],{"categories":6220},[70],{"categories":6222},[124],{"categories":6224},[70],{"categories":6226},[70],{"categories":6228},[],{"categories":6230},[],{"categories":6232},[],{"categories":6234},[70],{"categories":6236},[124],{"categories":6238},[212],{"categories":6240},[70],{"categories":6242},[],{"categories":6244},[124],{"categories":6246},[70],{"categories":6248},[70],{"categories":6250},[114],{"categories":6252},[],{"categories":6254},[],{"categories":6256},[70],{"categories":6258},[70],{"categories":6260},[124],{"categories":6262},[212],{"categories":6264},[70],{"categories":6266},[160],{"categories":6268},[],{"categories":6270},[70],{"categories":6272},[70],{"categories":6274},[241],{"categories":6276},[160],{"categories":6278},[241],{"categories":6280},[163],{"categories":6282},[70],{"categories":6284},[70],{"categories":6286},[],{"categories":6288},[],{"categories":6290},[124],{"categories":6292},[],{"categories":6294},[70],{"categories":6296},[455],{"categories":6298},[70],{"categories":6300},[70],{"categories":6302},[70],{"categories":6304},[70],{"categories":6306},[],{"categories":6308},[124],{"categories":6310},[70],{"categories":6312},[70],{"categories":6314},[],{"categories":6316},[124],{"categories":6318},[70],{"categories":6320},[160],{"categories":6322},[70],{"categories":6324},[241],{"categories":6326},[119],{"categories":6328},[127],{"categories":6330},[70],{"categories":6332},[70],{"categories":6334},[124],{"categories":6336},[163],{"categories":6338},[124],{"categories":6340},[124],{"categories":6342},[],{"categories":6344},[70],{"categories":6346},[124],{"categories":6348},[],{"categories":6350},[70],{"categories":6352},[],{"categories":6354},[160],{"categories":6356},[119],{"categories":6358},[],{"categories":6360},[70],{"categories":6362},[70],{"categories":6364},[70],{"categories":6366},[],{"categories":6368},[124],{"categories":6370},[212],{"categories":6372},[114],{"categories":6374},[70],{"categories":6376},[],{"categories":6378},[119],{"categories":6380},[241],{"categories":6382},[70],{"categories":6384},[138],{"categories":6386},[114],{"categories":6388},[163],{"categories":6390},[119],{"categories":6392},[138],{"categories":6394},[124],{"categories":6396},[138],{"categories":6398},[],{"categories":6400},[70],{"categories":6402},[127],{"categories":6404},[70],{"categories":6406},[],{"categories":6408},[124],{"categories":6410},[114],{"categories":6412},[212],{"categories":6414},[70],{"categories":6416},[114],{"categories":6418},[124],{"categories":6420},[282],{"categories":6422},[70],{"categories":6424},[70],{"categories":6426},[70],{"categories":6428},[70],{"categories":6430},[70],{"categories":6432},[114],{"categories":6434},[70],{"categories":6436},[138],{"categories":6438},[163],{"categories":6440},[124],{"categories":6442},[],{"categories":6444},[70],{"categories":6446},[70],{"categories":6448},[70],{"categories":6450},[138],{"categories":6452},[124],{"categories":6454},[160],{"categories":6456},[138],{"categories":6458},[70],{"categories":6460},[127],{"categories":6462},[],{"categories":6464},[212],{"categories":6466},[138],{"categories":6468},[160],{"categories":6470},[70],{"categories":6472},[114],{"categories":6474},[124],{"categories":6476},[70],{"categories":6478},[70],{"categories":6480},[124],{"categories":6482},[127],{"categories":6484},[70],{"categories":6486},[124],{"categories":6488},[70],{"categories":6490},[119],{"categories":6492},[124],{"categories":6494},[124,282],{"categories":6496},[70],{"categories":6498},[70],{"categories":6500},[124],{"categories":6502},[138],{"categories":6504},[70],{"categories":6506},[70],{"categories":6508},[163],{"categories":6510},[124],{"categories":6512},[241],{"categories":6514},[124],{"categories":6516},[119],{"categories":6518},[],{"categories":6520},[124],{"categories":6522},[70],{"categories":6524},[119],{"categories":6526},[],{"categories":6528},[],{"categories":6530},[138],{"categories":6532},[70],{"categories":6534},[70],{"categories":6536},[124],{"categories":6538},[163],{"categories":6540},[241],{"categories":6542},[70],{"categories":6544},[70],{"categories":6546},[70],{"categories":6548},[124],{"categories":6550},[],{"categories":6552},[124],{"categories":6554},[160],{"categories":6556},[70],{"categories":6558},[124],{"categories":6560},[124],{"categories":6562},[70],{"categories":6564},[],{"categories":6566},[160],{"categories":6568},[138],{"categories":6570},[3134],{"categories":6572},[114],{"categories":6574},[138],{"categories":6576},[70],{"categories":6578},[124],{"categories":6580},[70],{"categories":6582},[70],{"categories":6584},[241],{"categories":6586},[138],{"categories":6588},[163],{"categories":6590},[],{"categories":6592},[160],{"categories":6594},[70],{"categories":6596},[70],{"categories":6598},[],{"categories":6600},[124],{"categories":6602},[70],{"categories":6604},[70],{"categories":6606},[70],{"categories":6608},[70],{"categories":6610},[124],{"categories":6612},[70],{"categories":6614},[70],{"categories":6616},[70],{"categories":6618},[127],{"categories":6620},[70],{"categories":6622},[124],{"categories":6624},[70],{"categories":6626},[70],{"categories":6628},[70],{"categories":6630},[70],{"categories":6632},[70],{"categories":6634},[70],{"categories":6636},[70],{"categories":6638},[119],{"categories":6640},[],{"categories":6642},[127],{"categories":6644},[160],{"categories":6646},[124],{"categories":6648},[70],{"categories":6650},[138],{"categories":6652},[],{"categories":6654},[138],{"categories":6656},[138],{"categories":6658},[124],{"categories":6660},[138],{"categories":6662},[70],{"categories":6664},[70],{"categories":6666},[70],{"categories":6668},[124],{"categories":6670},[138],{"categories":6672},[70],{"categories":6674},[70],{"categories":6676},[70],{"categories":6678},[124],{"categories":6680},[160],{"categories":6682},[70],{"categories":6684},[70],{"categories":6686},[70],{"categories":6688},[119],{"categories":6690},[70],{"categories":6692},[124],{"categories":6694},[212],{"categories":6696},[],{"categories":6698},[70],{"categories":6700},[163],{"categories":6702},[124],{"categories":6704},[70],{"categories":6706},[70],{"categories":6708},[],{"categories":6710},[70],{"categories":6712},[70],{"categories":6714},[160],{"categories":6716},[70],{"categories":6718},[70],{"categories":6720},[124],{"categories":6722},[241],{"categories":6724},[],{"categories":6726},[],{"categories":6728},[138],{"categories":6730},[70],{"categories":6732},[70],{"categories":6734},[160],{"categories":6736},[70],{"categories":6738},[138],{"categories":6740},[160],{"categories":6742},[70],{"categories":6744},[70],{"categories":6746},[241],{"categories":6748},[163],{"categories":6750},[70],{"categories":6752},[70],{"categories":6754},[114],{"categories":6756},[124],{"categories":6758},[70],{"categories":6760},[70],{"categories":6762},[124],{"categories":6764},[119],{"categories":6766},[124],{"categories":6768},[138],{"categories":6770},[70],{"categories":6772},[119],{"categories":6774},[],{"categories":6776},[70],{"categories":6778},[163],{"categories":6780},[70],{"categories":6782},[70],{"categories":6784},[],{"categories":6786},[160],{"categories":6788},[70],{"categories":6790},[124],{"categories":6792},[163],{"categories":6794},[70],{"categories":6796},[138],{"categories":6798},[138],{"categories":6800},[138],{"categories":6802},[70],{"categories":6804},[124],{"categories":6806},[124],{"categories":6808},[70],{"categories":6810},[124],{"categories":6812},[70],{"categories":6814},[70],{"categories":6816},[212],{"categories":6818},[163],{"categories":6820},[163],{"categories":6822},[],{"categories":6824},[160],{"categories":6826},[70],{"categories":6828},[70],{"categories":6830},[138],{"categories":6832},[],{"categories":6834},[160],{"categories":6836},[160],{"categories":6838},[160],{"categories":6840},[],{"categories":6842},[124],{"categories":6844},[70],{"categories":6846},[],{"categories":6848},[114],{"categories":6850},[119],{"categories":6852},[],{"categories":6854},[70],{"categories":6856},[70],{"categories":6858},[],{"categories":6860},[138],{"categories":6862},[],{"categories":6864},[],{"categories":6866},[],{"categories":6868},[],{"categories":6870},[70],{"categories":6872},[160],{"categories":6874},[],{"categories":6876},[],{"categories":6878},[70],{"categories":6880},[70],{"categories":6882},[70],{"categories":6884},[163],{"categories":6886},[70],{"categories":6888},[163],{"categories":6890},[],{"categories":6892},[163],{"categories":6894},[163],{"categories":6896},[282],{"categories":6898},[124],{"categories":6900},[138],{"categories":6902},[],{"categories":6904},[],{"categories":6906},[163],{"categories":6908},[138],{"categories":6910},[138],{"categories":6912},[138],{"categories":6914},[],{"categories":6916},[114],{"categories":6918},[138],{"categories":6920},[138],{"categories":6922},[114],{"categories":6924},[138],{"categories":6926},[119],{"categories":6928},[138],{"categories":6930},[138],{"categories":6932},[138],{"categories":6934},[163],{"categories":6936},[160],{"categories":6938},[160],{"categories":6940},[70],{"categories":6942},[138],{"categories":6944},[163],{"categories":6946},[282],{"categories":6948},[163],{"categories":6950},[163],{"categories":6952},[163],{"categories":6954},[],{"categories":6956},[119],{"categories":6958},[],{"categories":6960},[282],{"categories":6962},[138],{"categories":6964},[138],{"categories":6966},[138],{"categories":6968},[124],{"categories":6970},[160,119],{"categories":6972},[163],{"categories":6974},[],{"categories":6976},[],{"categories":6978},[163],{"categories":6980},[],{"categories":6982},[163],{"categories":6984},[160],{"categories":6986},[124],{"categories":6988},[],{"categories":6990},[138],{"categories":6992},[70],{"categories":6994},[212],{"categories":6996},[],{"categories":6998},[70],{"categories":7000},[],{"categories":7002},[160],{"categories":7004},[114],{"categories":7006},[163],{"categories":7008},[],{"categories":7010},[138],{"categories":7012},[160],[7014,7112,7195,7316],{"id":7015,"title":7016,"ai":7017,"body":7023,"categories":7079,"created_at":71,"date_modified":71,"description":63,"extension":72,"faq":71,"featured":73,"kicker_label":71,"meta":7080,"navigation":90,"path":7100,"published_at":7101,"question":71,"scraped_at":7102,"seo":7103,"sitemap":7104,"source_id":7105,"source_name":97,"source_type":98,"source_url":7106,"stem":7107,"tags":7108,"thumbnail_url":71,"tldr":7109,"tweet":71,"unknown_tags":7110,"__hash__":7111},"summaries\u002Fsummaries\u002F79f82c07ea7441fe-trl-code-guide-sft-to-grpo-llm-alignment-on-t4-gpu-summary.md","TRL Code Guide: SFT to GRPO LLM Alignment on T4 GPU",{"provider":7,"model":7018,"input_tokens":7019,"output_tokens":7020,"processing_time_ms":7021,"cost_usd":7022},"x-ai\u002Fgrok-4.1-fast",9458,2615,35753,0.00269195,{"type":14,"value":7024,"toc":7073},[7025,7029,7037,7041,7051,7055,7061,7065],[17,7026,7028],{"id":7027},"lora-and-trl-setup-enables-post-training-on-limited-hardware","LoRA and TRL Setup Enables Post-Training on Limited Hardware",[22,7030,7031,7032,7036],{},"Use LoRA (r=8, alpha=16, dropout=0.05, targets=",[7033,7034,7035],"span",{},"'q_proj','k_proj','v_proj','o_proj'",") with TRL trainers to adapt Qwen\u002FQwen2.5-0.5B-Instruct on T4 GPU (16GB). Common args across stages: num_train_epochs=1, gradient_checkpointing=True, bf16 if supported else fp16, logging_steps=10, report_to=\"none\", save_strategy=\"no\". Install stack: torchao>=0.16, trl>=0.20, transformers>=4.45, peft>=0.13, bitsandbytes. Helpers like chat_generate apply chat template, generate with temp=0.7\u002Ftop_p=0.9. Cleanup VRAM with gc.collect() + torch.cuda.empty_cache() between stages to fit in Colab.",[17,7038,7040],{"id":7039},"sft-and-rm-build-imitation-and-reward-signals","SFT and RM Build Imitation and Reward Signals",[22,7042,7043,7044,7047,7048,7050],{},"For Supervised Fine-Tuning, load trl-lib\u002FCapybara (train",[7033,7045,7046],{},":300","), use SFTConfig(per_device_train_batch_size=2, gradient_accumulation_steps=4, learning_rate=2e-4, max_length=768). Trainer imitates high-quality chat responses; post-train inference on \"Explain bias-variance tradeoff in two sentences\" yields coherent output. Reward Modeling on trl-lib\u002Fultrafeedback_binarized (train",[7033,7049,7046],{},") uses RewardConfig(batch_size=2, accum_steps=2, lr=1e-4, max_length=512), LoRA task_type=\"SEQ_CLS\". Trains to score chosen vs. rejected pairs, producing a preference-based reward without explicit RL.",[17,7052,7054],{"id":7053},"dpo-skips-rm-for-direct-preference-alignment","DPO Skips RM for Direct Preference Alignment",[22,7056,7057,7058,7060],{},"DPOTrainer on same ultrafeedback_binarized",[7033,7059,7046],{}," simplifies via implicit rewards: DPOConfig(batch_size=1, accum_steps=4, lr=5e-6, beta=0.1, max_length=512, max_prompt_length=256). Beta controls KL-divergence from reference policy, preventing mode collapse. Optimizes policy to prefer chosen over rejected responses directly, reducing steps vs. traditional RM+PPO.",[17,7062,7064],{"id":7063},"grpo-uses-custom-rewards-to-sharpen-reasoning","GRPO Uses Custom Rewards to Sharpen Reasoning",[22,7066,7067,7068,7072],{},"GRPOTrainer generates num_generations=4 completions per prompt (max_prompt_length=128, max_completion_length=96, max_steps=15), ranks via reward_funcs. Custom dataset: 200 synthetic math problems (e.g., \"Solve 17 + 28 =\", gold=eval). Rewards: correctness_reward (1.0 if last extracted number matches gold else 0), brevity_reward (max(0,1-len(c)\u002F200)",[7069,7070,7071],"em",{},"0.2). GRPOConfig(lr=1e-5, batch=2, accum=2). Inference on \"17+28?\", \"9","7?\", \"100-47?\" produces accurate, concise answers like final numbers, improving verifiable task performance over base.",{"title":63,"searchDepth":64,"depth":64,"links":7074},[7075,7076,7077,7078],{"id":7027,"depth":64,"text":7028},{"id":7039,"depth":64,"text":7040},{"id":7053,"depth":64,"text":7054},{"id":7063,"depth":64,"text":7064},[70],{"content_references":7081,"triage":7097},[7082,7085,7088,7090,7092],{"type":77,"title":7083,"url":7084,"context":80},"TRL","https:\u002F\u002Fgithub.com\u002Fhuggingface\u002Ftrl",{"type":7086,"title":7087,"context":80},"dataset","trl-lib\u002FCapybara",{"type":7086,"title":7089,"context":80},"trl-lib\u002Fultrafeedback_binarized",{"type":77,"title":7091,"context":80},"Qwen\u002FQwen2.5-0.5B-Instruct",{"type":7093,"title":7094,"url":7095,"context":7096},"other","trl_llm_post_training_sft_dpo_grpo_marktechpost.py","https:\u002F\u002Fgithub.com\u002FMarktechpost\u002FAI-Agents-Projects-Tutorials\u002Fblob\u002Fmain\u002FLLM%20Projects\u002Ftrl_llm_post_training_sft_dpo_grpo_marktechpost.py","recommended",{"relevance":85,"novelty":86,"quality":86,"actionability":85,"composite":7098,"reasoning":7099},4.55,"Category: AI & LLMs. The article provides a detailed guide on using TRL and LoRA for LLM post-training, addressing practical applications for developers looking to implement AI features. It includes specific configurations and techniques that can be directly applied in production, making it highly actionable.","\u002Fsummaries\u002F79f82c07ea7441fe-trl-code-guide-sft-to-grpo-llm-alignment-on-t4-gpu-summary","2026-05-01 20:52:08","2026-05-03 17:01:49",{"title":7016,"description":63},{"loc":7100},"79f82c07ea7441fe","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F01\u002Fa-coding-guide-on-llm-post-training-with-trl-from-supervised-fine-tuning-to-dpo-and-grpo-reasoning\u002F","summaries\u002F79f82c07ea7441fe-trl-code-guide-sft-to-grpo-llm-alignment-on-t4-gpu-summary",[102,104,103],"Train Qwen2.5-0.5B via SFT, RM, DPO, GRPO using TRL+LoRA on Colab T4: configs include r=8 LoRA, 300-sample datasets, epochs=1, small batches\u002Faccum for memory efficiency, custom math rewards boost reasoning.",[],"py8Fe1-Noi99CHywKy61Q363dqRBmUxl6tZ9TDJOp3E",{"id":7113,"title":7114,"ai":7115,"body":7120,"categories":7174,"created_at":71,"date_modified":71,"description":63,"extension":72,"faq":71,"featured":73,"kicker_label":71,"meta":7175,"navigation":90,"path":7183,"published_at":7184,"question":71,"scraped_at":7184,"seo":7185,"sitemap":7186,"source_id":7187,"source_name":97,"source_type":98,"source_url":7188,"stem":7189,"tags":7190,"thumbnail_url":71,"tldr":7192,"tweet":71,"unknown_tags":7193,"__hash__":7194},"summaries\u002Fsummaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary.md","DiffusionGemma: Parallel Text Generation via Diffusion",{"provider":7,"model":8,"input_tokens":7116,"output_tokens":7117,"processing_time_ms":7118,"cost_usd":7119},9607,615,4079,0.001500625,{"type":14,"value":7121,"toc":7169},[7122,7126,7129,7133,7136,7162,7166],[17,7123,7125],{"id":7124},"parallel-decoding-via-text-diffusion","Parallel Decoding via Text Diffusion",[22,7127,7128],{},"DiffusionGemma departs from the standard autoregressive paradigm—where tokens are generated sequentially, one at a time—by utilizing text diffusion. Inspired by image generation models, it begins with a canvas of random placeholder tokens and iteratively refines them in parallel. This approach allows the model to finalize approximately 15–20 tokens per forward pass, significantly increasing throughput on dedicated GPUs.",[17,7130,7132],{"id":7131},"architecture-and-performance","Architecture and Performance",[22,7134,7135],{},"Built on the Gemma 4 26B-A4B backbone, the model is a Mixture of Experts (MoE) architecture that activates only 3.8B parameters during inference. Key technical features include:",[33,7137,7138,7144,7150,7156],{},[36,7139,7140,7143],{},[39,7141,7142],{},"Bidirectional Attention:"," Unlike autoregressive models restricted to causal (backward-looking) attention, DiffusionGemma uses bidirectional attention during denoising, allowing tokens to attend to the entire sequence.",[36,7145,7146,7149],{},[39,7147,7148],{},"Self-Correction:"," The model can re-noise and refine low-confidence tokens during the denoising process, a capability impossible in standard autoregressive decoding where tokens are committed once generated.",[36,7151,7152,7155],{},[39,7153,7154],{},"Hardware Utilization:"," By shifting the bottleneck from memory bandwidth to compute, the model achieves 1000+ tokens per second on an NVIDIA H100 and 700+ tokens per second on an NVIDIA GeForce RTX 5090.",[36,7157,7158,7161],{},[39,7159,7160],{},"Hybrid Inference:"," For longer sequences, it employs 'Block Autoregressive Diffusion,' where 256-token blocks are denoised in parallel and then committed to the KV cache before starting a new canvas.",[17,7163,7165],{"id":7164},"trade-offs-and-use-cases","Trade-offs and Use Cases",[22,7167,7168],{},"Google explicitly positions DiffusionGemma for local, low-latency, single-user workloads like in-line editing and rapid iteration. It is not intended to replace standard autoregressive models for high-quality production tasks, as its overall output quality is lower. Furthermore, the speed advantages diminish in high-concurrency cloud environments where autoregressive models already saturate compute resources efficiently. When quantized, the model fits within 18GB of VRAM, making it accessible for high-end consumer hardware.",{"title":63,"searchDepth":64,"depth":64,"links":7170},[7171,7172,7173],{"id":7124,"depth":64,"text":7125},{"id":7131,"depth":64,"text":7132},{"id":7164,"depth":64,"text":7165},[70],{"content_references":7176,"triage":7180},[7177],{"type":77,"title":7178,"url":7179,"context":80},"DiffusionGemma 26B-A4B-it","https:\u002F\u002Fhuggingface.co\u002Fgoogle\u002Fdiffusiongemma-26B-A4B-it",{"relevance":86,"novelty":87,"quality":86,"actionability":87,"composite":7181,"reasoning":7182},3.6,"Category: AI & LLMs. The article discusses a new model, DiffusionGemma, which offers a novel approach to text generation, addressing a specific audience pain point regarding performance and efficiency in AI workflows. It provides technical insights and potential use cases, but lacks detailed actionable steps for implementation.","\u002Fsummaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary","2026-06-11 12:57:14",{"title":7114,"description":63},{"loc":7183},"89df0446e415c993","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F06\u002F10\u002Fgoogle-ai-releases-diffusiongemma-a-26b-moe-open-model-using-text-diffusion-for-up-to-4x-faster-generation\u002F","summaries\u002F89df0446e415c993-diffusiongemma-parallel-text-generation-via-diffus-summary",[102,7191,103,104],"ai-tools","Google's DiffusionGemma is a 26B MoE model that uses text diffusion instead of autoregressive decoding, enabling up to 4x faster generation for local, interactive workflows.",[],"OL0OihGMYCueQkJpZPFWtH3pz-h8zXIoCVFe0j46zGI",{"id":7196,"title":7197,"ai":7198,"body":7203,"categories":7288,"created_at":71,"date_modified":71,"description":63,"extension":72,"faq":71,"featured":73,"kicker_label":71,"meta":7289,"navigation":90,"path":7300,"published_at":7301,"question":71,"scraped_at":7302,"seo":7303,"sitemap":7304,"source_id":7305,"source_name":7306,"source_type":7307,"source_url":7308,"stem":7309,"tags":7310,"thumbnail_url":7311,"tldr":7312,"tweet":7313,"unknown_tags":7314,"__hash__":7315},"summaries\u002Fsummaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary.md","Scaling Transformer Training to 5 Million Tokens",{"provider":7,"model":8,"input_tokens":7199,"output_tokens":7200,"processing_time_ms":7201,"cost_usd":7202},6017,673,3862,0.00251375,{"type":14,"value":7204,"toc":7282},[7205,7209,7212,7216,7219,7251,7255,7258,7262],[17,7206,7208],{"id":7207},"the-memory-bottleneck-in-long-context-training","The Memory Bottleneck in Long-Context Training",[22,7210,7211],{},"Training standard transformer models with massive context windows (e.g., 3M+ tokens) faces two primary constraints: quadratic computational complexity and linear memory growth. Even on high-end hardware like an 8xH100 node, standard implementations fail because the model parameters and attention activations quickly exceed available GPU memory.",[17,7213,7215],{"id":7214},"the-stack-of-optimization-techniques","The Stack of Optimization Techniques",[22,7217,7218],{},"To reach a 3-million token context, a layered approach is required to manage memory usage:",[33,7220,7221,7227,7233,7239,7245],{},[36,7222,7223,7226],{},[39,7224,7225],{},"Fully Sharded Data Parallelism (FSDP):"," Distributes model parameters across all available GPUs to prevent memory exhaustion from the model weights alone.",[36,7228,7229,7232],{},[39,7230,7231],{},"DeepSpeed Ulysses:"," A context parallelism technique that distributes attention heads across GPUs. Instead of every GPU computing the full sequence, each GPU handles specific heads, reducing activation memory by approximately 8x.",[36,7234,7235,7238],{},[39,7236,7237],{},"Activation Checkpointing:"," Recomputes activations during the backward pass rather than storing them, providing another 8x reduction in memory usage.",[36,7240,7241,7244],{},[39,7242,7243],{},"CPU Offloading:"," Moves transformer block inputs to CPU memory when not actively needed for backpropagation, prefetching them just-in-time to minimize performance impact.",[36,7246,7247,7250],{},[39,7248,7249],{},"Chunked Sequence Training:"," Tiles element-wise operations (like loss calculations and MLPs) across the sequence length to avoid allocating massive buffers that scale linearly with the token count.",[17,7252,7254],{"id":7253},"untied-ulysses-pushing-to-5-million-tokens","Untied Ulysses: Pushing to 5 Million Tokens",[22,7256,7257],{},"To surpass the 3-million token limit, the team developed \"Untied Ulysses.\" This technique refines context parallelism by further chunking attention heads. Instead of allocating a single large buffer per head group, the system iterates through smaller chunks of heads, reusing the same memory buffers across iterations. This significantly lowers activation memory requirements with negligible impact on throughput.",[17,7259,7261],{"id":7260},"practical-implementation-advice","Practical Implementation Advice",[33,7263,7264,7270,7276],{},[36,7265,7266,7269],{},[39,7267,7268],{},"Profiling is critical:"," Use tools like the PyTorch Profiler to identify exactly where memory is being consumed, as bottlenecks often appear in unexpected places.",[36,7271,7272,7275],{},[39,7273,7274],{},"Trade-offs:"," There is a direct relationship between chunk size and throughput. Larger chunks increase memory utilization but can improve overall training speed.",[36,7277,7278,7281],{},[39,7279,7280],{},"Reinvesting Memory:"," By stacking these optimizations, you can free up memory that can be reinvested into other training stages or used to push context lengths even further.",{"title":63,"searchDepth":64,"depth":64,"links":7283},[7284,7285,7286,7287],{"id":7207,"depth":64,"text":7208},{"id":7214,"depth":64,"text":7215},{"id":7253,"depth":64,"text":7254},{"id":7260,"depth":64,"text":7261},[70],{"content_references":7290,"triage":7297},[7291,7295],{"type":77,"title":7292,"author":7293,"context":7294},"DeepSpeed Ulysses","Microsoft","cited",{"type":77,"title":7296,"context":7096},"PyTorch Profiler",{"relevance":85,"novelty":86,"quality":86,"actionability":86,"composite":7298,"reasoning":7299},4.35,"Category: AI & LLMs. The article provides in-depth techniques for optimizing transformer training, directly addressing the audience's need for practical applications in AI model development. It discusses specific methods like Fully Sharded Data Parallelism and Untied Ulysses, which are actionable for developers looking to implement long-context training.","\u002Fsummaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary","2026-06-08 17:00:21","2026-06-09 12:56:17",{"title":7197,"description":63},{"loc":7300},"1ac17c99e1a87b1f","AI Engineer","video","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=TUnPNY4E2fw","summaries\u002F1ac17c99e1a87b1f-scaling-transformer-training-to-5-million-tokens-summary",[102,103,104,7191],"https:\u002F\u002Fi.ytimg.com\u002Fvi\u002FTUnPNY4E2fw\u002Fhqdefault.jpg","To train models with multi-million token contexts, you must stack memory-optimization techniques—including context parallelism, activation checkpointing, and a novel method called 'Untied Ulysses'—to bypass GPU memory bottlenecks.","This is a technical breakdown of the memory-optimization stack required to train models on extremely long context windows (up to 5 million tokens). The speaker details how to combine standard techniques like [DeepSpeed Ulysses](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002FDeepSpeed) and activation checkpointing with their own \"Untied Ulysses\" method to reduce memory overhead by chunking and reusing attention buffers.",[],"vdZh7ZzpnTzdTG3G79QASc2ywoHe_prr-WYngZH8xkI",{"id":7317,"title":7318,"ai":7319,"body":7324,"categories":7392,"created_at":71,"date_modified":71,"description":63,"extension":72,"faq":71,"featured":73,"kicker_label":71,"meta":7393,"navigation":90,"path":7404,"published_at":7405,"question":71,"scraped_at":7406,"seo":7407,"sitemap":7408,"source_id":7409,"source_name":97,"source_type":98,"source_url":7410,"stem":7411,"tags":7412,"thumbnail_url":71,"tldr":7413,"tweet":71,"unknown_tags":7414,"__hash__":7415},"summaries\u002Fsummaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary.md","Benchmarking LLM Compression: FP8, GPTQ, and SmoothQuant",{"provider":7,"model":8,"input_tokens":7320,"output_tokens":7321,"processing_time_ms":7322,"cost_usd":7323},10756,674,2766,0.0037,{"type":14,"value":7325,"toc":7388},[7326,7330,7338,7358,7362,7365,7385],[17,7327,7329],{"id":7328},"quantization-strategies-for-llm-efficiency","Quantization Strategies for LLM Efficiency",[22,7331,7332,7333,7337],{},"Post-training quantization (PTQ) is essential for deploying LLMs in resource-constrained environments. This tutorial demonstrates three distinct approaches using the ",[7334,7335,7336],"code",{},"llmcompressor"," library to reduce model footprint and improve inference speed while maintaining output quality:",[33,7339,7340,7346,7352],{},[36,7341,7342,7345],{},[39,7343,7344],{},"FP8 Dynamic Quantization:"," A data-free approach that compresses linear layers into 8-bit precision while keeping the language modeling head in higher precision. It is the fastest to implement and provides a baseline for efficiency gains.",[36,7347,7348,7351],{},[39,7349,7350],{},"GPTQ W4A16:"," A more aggressive compression method that reduces weights to 4-bit while maintaining 16-bit activation precision. This requires a calibration dataset (in this case, 256 samples from UltraChat) to minimize reconstruction error, resulting in significantly smaller model sizes.",[36,7353,7354,7357],{},[39,7355,7356],{},"SmoothQuant + GPTQ W8A8:"," An advanced pipeline that addresses activation outliers using SmoothQuant (smoothing strength 0.8) before applying 8-bit quantization. This combination balances accuracy recovery with the performance benefits of 8-bit operations.",[17,7359,7361],{"id":7360},"benchmarking-and-deployment-workflow","Benchmarking and Deployment Workflow",[22,7363,7364],{},"To evaluate these methods, the implementation establishes a standardized benchmarking suite that measures:",[33,7366,7367,7373,7379],{},[36,7368,7369,7372],{},[39,7370,7371],{},"Disk Size:"," Total storage footprint in GB.",[36,7374,7375,7378],{},[39,7376,7377],{},"Perplexity (PPL):"," Evaluated on the WikiText-2 dataset to ensure compression hasn't degraded model reasoning.",[36,7380,7381,7384],{},[39,7382,7383],{},"Generation Latency & Throughput:"," Measured in seconds and tokens per second (tok\u002Fs) using a consistent prompt.",[22,7386,7387],{},"The workflow emphasizes a \"save-and-test\" cycle, where each compressed model is saved as a reusable artifact. By comparing the FP16 baseline against these quantized variants, developers can make informed trade-offs between model size and inference performance, creating a repeatable pipeline for production-ready model deployment.",{"title":63,"searchDepth":64,"depth":64,"links":7389},[7390,7391],{"id":7328,"depth":64,"text":7329},{"id":7360,"depth":64,"text":7361},[70],{"content_references":7394,"triage":7402},[7395,7397,7400],{"type":77,"title":7336,"url":7396,"context":7096},"https:\u002F\u002Fgithub.com\u002Fvllm-project\u002Fllm-compressor",{"type":7086,"title":7398,"url":7399,"context":7294},"UltraChat 200k","https:\u002F\u002Fhuggingface.co\u002Fdatasets\u002FHuggingFaceH4\u002Fultrachat_200k",{"type":7086,"title":7401,"context":7294},"WikiText-2",{"relevance":85,"novelty":86,"quality":86,"actionability":85,"composite":7098,"reasoning":7403},"Category: AI & LLMs. The article provides a detailed practical guide on compressing LLMs, addressing a core topic of AI engineering with actionable insights on quantization strategies. It includes specific methods and a benchmarking workflow that developers can implement directly in their projects.","\u002Fsummaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary","2026-05-17 18:19:09","2026-05-17 18:48:19",{"title":7318,"description":63},{"loc":7404},"beb19294561867ca","https:\u002F\u002Fwww.marktechpost.com\u002F2026\u002F05\u002F17\u002Fa-coding-implementation-to-compress-and-benchmark-instruction-tuned-llms-with-fp8-gptq-and-smoothquant-quantization-using-llmcompressor\u002F","summaries\u002Fbeb19294561867ca-benchmarking-llm-compression-fp8-gptq-and-smoothqu-summary",[102,7191,104,103],"A practical guide to compressing instruction-tuned LLMs using llmcompressor, comparing FP8 dynamic, GPTQ W4A16, and SmoothQuant W8A8 quantization strategies across size, latency, and perplexity.",[],"30L_xT8fTg-Uhmof_yAXXdldKTf6tCZLD87bHm4DkII"]