1. Does management matter? Evidence from India Nick Bloom (Stanford) Benn Eifert (Berkeley) Aprajit Mahajan (Stanford) David McKenzie (World Bank) John Roberts (Stanford GSB) Labor Studies, July 25 th 2011

2. Management score Random sample of manufacturing population firms 100 to 5000 employees. Source: Bloom and Van Reenen (2007, QJE) and Bloom and Van Reenen (2010, JEP) 2.62.833.23.4 US Japan Germany Sweden Canada Australia UK Italy France New Zealand Mexico Poland Republic of Ireland Portugal Chile Argentina Greece Brazil China India One motivation for looking at management is that country management scores are correlated with GDP

3. Management score US (N=695 firms) India (N=620 firms) Density And firm management spreads look like TFP spreads

4. But does management cause any of these TFP differences between firms and countries? Massive literature of case-studies and surveys but no consensus Syverson (2011, JEL) no potential driving factor of productivity has seen a higher ratio of speculation to empirical study.

5. So we run an experiment on large firms to evaluate the impact of modern management practices on TFP Experiment on 20 plants in large multi-plant firms (average 300 employees and $7m sales) near Mumbai making cotton fabric Randomized treatment plants get 5 months of management consulting intervention, controls get 1 month Consulting is on 38 specific practices tied to factory operations, quality and inventory control Collect weekly data on all plants from 2008 to 2010.

6. Plants are large compounds, with several buildings

7. Plants operate day and night making cotton fabric

8. Garbage outside the plantGarbage inside a plant Chemicals without any coveringFlammable garbage in a plant They are typically dirty and disorganized

9. They have extensive quality repair halls

10. They also have large scattered inventories of yarn

11. 11 Management practices before and after treatment Performance of the plants before and after treatment Why were these practices not introduced before?

12. Intervention aimed to improve 38 core textile management practices in 5 areas Targeted practices in 5 areas: operations, quality, inventory, HR and sales & orders

13. Months after the diagnostic phase.2.3.4.5.6 -10-8-6-4-2024681012 Adoption of the 38 management practices over time Treatment plants Control plants Share of 38 practices adopted Non-experimental plants in treatment firms Months after the start of the diagnostic phase

14. Management practices before and after treatment Performance of the plants before and after treatment Why were these practices not introduced before?

15. Look at four outcomes we have weekly data for Quality: Measured by Quality Defects Index (QDI) – a weighted average of quality defects (higher=worse quality) Inventory: Measured in log tons Output: Production picks (one pick=one run of the shuttle) Productivity: Log(VA) – 0.42*log(K) – 0.58*log(L) Estimate Intention to Treat (ITT) and also regressions: Run in OLS and also instrument management with treatment. 15

16. Poor quality meant 19% of manpower went on repairs Workers spread cloth over lighted plates to spot defectsLarge room full of repair workers (the day shift) Defects lead to about 5% of cloth being scrappedDefects are repaired by hand or cut out from cloth

17. 17 Previously mending was recorded only to cross- check against customers claims for rebates

18. 18 Now mending is recorded daily in a standard format, so it can analyzed by loom, shift, design & weaver

19. The quality data is now collated and analyzed as part of the new daily production meetings Plant managers meet with heads of departments for quality, inventory, weaving, maintenance, warping etc.

20. Quality improved significantly in treatment plants Control plants Treatment plants Weeks after the start of the experiment Quality defects index (higher score=lower quality) Note: solid lines are point estimates, dashed lines are 95% confidence intervals

21. 21 Stock is organized, labeled, and entered into the computer with details of the type, age and location. Organizing and racking inventory enables firms to substantially reduce capital stock

22. Inventory fell in treatment plants Control plants Treatment plants Weeks after the start of the experiment Yarn inventory Note: solid lines are point estimates, dashed lines are 95% confidence intervals

23. 23 Many treated firms have also introduced basic initiatives (called 5S) to organize the plant floor Marking out the area around the model machine Snag tagging to identify the abnormalities

24. 24 Spare parts were also organized, reducing downtime (parts can be found quickly) Nuts & bolts Tools Spare parts

25. 25 Production data is now collected in a standardized format, for discussion in the daily meetings Before (not standardized, on loose pieces of paper) After (standardized, so easy to enter daily into a computer)

26. 26 Daily performance boards have also been put up, with incentive pay for employees based on this

27. TFP rose in treatment plants vs controls Control plants Treatment plants Weeks after the start of the experiment Total factor productivity Note: solid lines are point estimates, dashed lines are 95% confidence intervals

28. Intention to Treat estimations Standard errors bootstrap clustered by firm. Intervention dummy zero before the intervention and 1 afterwards for the treatment plants. Dropped the 6+ months of data spanning the intervention itself Dep. Var.Quality Defects i,t Inventory i,t Output i,t TFP i,t Intervention i,t -0.565***-0.273**0.098***0.169** (0.231)(0.116)(0.036)(0.067) Small sample robustness Ibragimov-Mueller (95% Conf. Intervals) [-0.782, -0.441] [-0.219, 0.001] [0.218, 0.470] [0.183, 0.511] Permutation Test (p-values) 0.040.130.040.05 Time FEs125122125122 Observations1396162719661447

29. OLS and IV estimations Standard errors bootstrap clustered by firm. The IV for management is cumulative weeks of treatment. Dep. Var.Quality Defects Invent. Output TFP Specification OLSIVOLSIVOLSIVOLSIV Management i,t -0.561-1.675**-0.639***-0.921***0.1270.320**0.1600.488** (0.440)(0.763)(0.242)(0.290)(0.099)(0.118)(0.179)(0.227) 1st stage Fstat 67.51 63.76 91.20 74.68 Time FEs113 114 113 Plant FEs20 18 20 Observations 1732 1977 2312 1779

30. 30 Management practices before and after treatment Performance of the plants before and after treatment Why were these practices not introduced before?

31. Why doesnt competition fix badly managed firms? Reallocation appears limited: Owners take all decisions as they worry about managers stealing. But owners time is constrained – they already work 72.4 hours average a week – limiting growth. As a result firm size is more linked to number of male family members (corr=0.689) than management scores (corr=0.223) Entry appears limited: capital intensive due to minimum scale (for a warping loom and 30 weaving looms at least $1m) Trade is restricted: 50% tariff on fabric imports from China

32. 32 Why dont these firms improve themselves (even worthwhile reducing costs for a monopolist…)? Asked the consultants to investigate the non-adoption of each of the 38 practices, in each plant, every other month Did this by discussion with the owners, managers, observation of the factory, and from trying to change management practices. Find this is primarily an information problem - Wrong information (do not believe worth doing) - No information (never heard of the practices)

33. 33 BASIC (>50% initial adoption, 9 practices) 1 month before 1 month after 3 months after 5 months after 9 months after No information 3.33.20.500 Wrong information 3022.415.415.214.4 Owner ability/time 1.10.80.50.8 Other 00000 Total non-adoption34.626.416.316.015.2 Basic practices were most constrained by wrong info (bad priors), advanced practices by lack of info ADVANCED (<5% initial adoption, 10 practices) 1 month before 1 month after 3 months after 5 months after 9 months after No information64.019.12.91.50 Wrong information30.950.7 49.347.1 Owner ability/time3.713.2 14.0 Other2.11.5 2.2 Total non-adoption98.584.678.266.263.2 Note: 14 treatment plants. Basic mainly quality and downtime recording, & worker bonuses. Advanced mainly review meetings, standard procedures & managers bonuses.

34. 34 Summary Management matters in Indian firms – large impacts on productivity and profitability from more modern practices A primary reason for bad management appears to be lack of information, which limited competition allows to persist Potential policy implications A) Competition and FDI: free product markets and encourage foreign multinationals to accelerate spread of best practices B) Training: improved basic training around management skills C) Rule of law: improve rule of law to encourage reallocation and ownership and control separation

35. Back Up 35

36. Can we learn from this small sample? (1/3) Small sample because this is expensive! (~75K per treated plant), why also no prior large-firm management experiments 1)Is this sample large enough to get significant results? Yes: - Homogeneous production, location, and technology, so most external shocks controlled for with time dummies. -Large plants with 80 looms and 130 employees so individual machine and employee shocks average out -Data from machines & logs so little measurement error -High frequency data: 114 weeks of data (large T)

37. Can we learn from this small sample? (2/3) 2) Need to use appropriate statistical inference: –Use bootstrap firm-clustered standard-errors as baseline –Also use permutation tests (12,376 possible ways of choosing 11 treated from 17 firms) to get test statistics which dont rely on asymptotics. –Use large T-asymptotics from Ibramigov-Mueller (2009) Remove time effects Estimate parameter of interest separately for each treatment firm, then treat resultant 11 estimates as a draw from a t distribution with 10 d.f. This provides robustness to heterogeneity across firms also. All three methods give similar results

38. Can we learn from this small sample? (3/3) 3) External validity: are these firms relatively representative of large firms in developing countries? While we focus on one region and one industry in one country, it is Indias largest industry in its commercial hub. Our firms seem at least broadly representative of firms in developing countries in terms of basic management practices (see next slide).

39. Table 1 AllTreatmntContrlDiff MeanMedianMinMaxMean p-value Sample sizes: Number of plants20n/a 146n/a Number of firms17n/a 116n/a Plants per firm1.652141.731.50.393 Firm/plant sizes: Employees per firm273250705002912360.454 Employees per plant134132602501441140.161 Hierarchical levels4.4437 0.935 Annual sales $m per firm7.4561.415.67.068.370.598 Current assets $m per firm12.87.92.8544.213.312.00.837 Management and plant ages: BVR Management score2.602.611.893.282.502.750.203 Management adoption rates0.2620.2570.080.5530.2550.2880.575 Age, experimental plant (years)19.416.524620.516.80.662

40. Note - the production technology has not changed much over time Warp beam Krill The warping looms at Lowell Mills in 1854, Massachusetts