A Scale for Measuring Sustainable Manufacturing Practices and Sustainability Performance: Validity and Reliability

Yousif M. Ibrahim, Norsiah Hami, Susan S. Abdulameer


Purpose: In quantitative studies, providing a valid and reliable instrument is necessary to ensure accurate results when measuring sustainable manufacturing practices (SMPs) and sustainability performance (SP). Therefore, this study aims to evaluate the validity and reliability of the measurements of SMPs and SP.

Methodology/Approach: The population of this study is top managers who have experience in the oil and gas industry (O&GI) in Iraq. Two tests were carried out in the present study: the pre-test and the pilot test.

Findings: In the pre-test, the comments made by six academician experts and three practitioners were used to rephrase the measurements items and modify them according to the requirements of the O&GI by the Iraqi context. Moreover, in the pilot test was all the items were reliable and were sufficiently correlated with their constructs.

Research Limitation/implication: There are some limitations to the current study. First, due to the small size of the study population, the pilot test sample in the current study was only 12 respondents. Future researchers can increase the sample size for the pilot test when they have a large population. Second, the validity and reliability of the measurements were tested in the current study in the oil and gas industry only. Future studies can test these measurements in other industries or small and Small and medium-sized enterprises (SMEs).

Originality/Value of paper: Theoretically, there are four contributions to the body of knowledge: first, introduce measures for SMPs according to the product life cycle view, it is limited in the literature. Second, these measures can be used by researchers to study the extent of SMPs and the SP of companies using descriptive statistics. Third, these measures can be used to investigate the impact of SMPs on SP by regression testing or structural equation modelling. Fourth, measures can be modified into open-ended questions for use in qualitative or mixed studies. Practically, there are two practical implications which explain in the conclusion.


sustainable manufacturing practices; sustainability performance; pre-test; pilot test; oil and gas industry

Full Text:



Abdul-Rashid, S.H., Sakundarini, N., Ghazilla, R.A.R. and Ramayah, T., 2017a. Drivers for the adoption of sustainable manufacturing practices: A Malaysia perspective. Int. J. Precis. Eng. Manuf.-Green Tech., [e-journal] 18(11), pp.1619-1631. DOI: 10.1007/s12541-017-0191-4.

Abdul-Rashid, S.H., Sakundarini, N., Ghazilla, R.A.R. and Ramayah, T., 2017b. 'The impact of sustainable manufacturing practices on sustainability performance: Empirical evidence from Malaysia. International Journal of Operations & Production Management, [e-journal] 37(2), pp.182-204. DOI: 10.1108/IJOPM-04-2015-0223.

Adams, J., Khan, H.T.A. and Raeside, R., 2014. Research Methods for Business and Social Science Students. 2nd ed. London: SAGE Publications.

Al-Haleem, A.A., Awadh, S.M. and Saeed, E.A.-J., 2013. Environmental Impact from Drilling and Production of oil Activities: Sources and Recommended Solutions. Iraqi Journal of Science, pp.46-53.

Alwin, D.F. and Krosnick, J.A., 1991. The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes. Sociological Methods & Research, [e-journal] 20(1), pp.139-181. DOI: 10.1177/0049124191020001005.

Andrews, F.M., 1984. Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach. The Public Opinion Quarterly, [e-journal] 48(2), pp.409-442. DOI: 10.1086/268840.

Bansal, P., 2005. Evolving sustainably: a longitudinal study of corporate sustainable development. Strategic Management Journal, [e-journal] 26(3), pp.197-218. DOI: 10.1002/smj.441.

Bell, J. and Waters, S., 2014. Doing Your Research Project: A Guide for First-Time Researchers. 6th ed. Berkshire, UK: McGraw-Hill Education.

Birkett, N.J., 1986. Selecting the number of response categories for a Likert-type scale. In: N. Rothwell, XII. Cognitive Aspects Of Survey Methodology. Washington, D.C. pp.488-492.

Bradburn, N.M., Sudman, S. and Wansink, B., 2004. Asking Questions: The Definitive Guide to Questionnaire Design -- For Market Research, Political Polls, and Social and Health Questionnaires. 2nd ed. Hoboken, NJ: John Wiley & Sons.

Bryman, A. and Bell, E., 2015. Business Research Methods. 4th ed. Oxford: Oxford University Press.

Coelho, P.S. and Esteves, S.P., 2007. The Choice between a Five-point and a Ten-point Scale in the Framework of Customer Satisfaction Measurement. International Journal of Market Research, [e-journal] 49(3), pp.313-339. DOI: 10.1177/147078530704900305.

Colton, D. and Covert, R.W., 2007. Designing and constructing instruments for social research and evaluation. San Francisco: John Wiley & Sons.

Cooper, D. and Schindler, P., 2014. Business Research Methods. 12th ed. USA: McGraw-Hill Higher Education.

Creswell, J.W. and Creswell, J.D., 2018. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 5th ed. USA: SAGE Publications.

Dawson, C., 2009. Introduction to Research Methods: A practical guide for anyone undertaking a research project. 4th ed. UK: Little, Brown Book Group.

De Vaus, D.A., 2002. Surveys in social research. 5th ed. New South Wales: Allen & Unwin.

DeVellis, R.F., 2016. Scale development: Theory and applications. 4th ed. USA: SAGE Publications.

Elhuni, R.M. and Ahmad, M.M., 2017. Key Performance Indicators for Sustainable Production Evaluation in Oil and Gas Sector. Procedia Manufacturing, [e-journal] 11 (Supplement C), pp.718-724. DOI: 10.1016/j.promfg.2017.07.172.

EPA (Environmental Protection Agency), 2003. Environmental Impact of the Petroleum Industry. Environmental Update #12, [onlien] June 2003. Available at: < https://cfpub.epa.gov/ncer_abstracts/index.cfm/fuseaction/display.files/fileID/14522 > [Accessed 1 July 2020].

Field, A., 2009. Discovering Statistics Using IBM SPSS Statistics. 3rd ed. USA: SAGE Publications.

Field, A., 2013. Discovering Statistics Using IBM SPSS Statistics. 4th ed. USA: SAGE Publications.

Fink, A., 2013. How to Conduct Surveys: A Step-by-step Guide. 5th ed. USA: SAGE Publications.

Fink, A., 2017. How To Conduct Surveys: A Step-by-Step Guide. 6th ed. USA: SAGE Publications.

Frank, M.D., Nwuche, A.C. and Anyanwu, S.A.C., 2016. Operations management activities and organizational sustainability in oil and gas companies in rivers state. International Journal of Advanced Academic Research, 2(11), pp.34-56.

Garland, R., 1991. The mid-point on a rating scale: Is it desirable?. Marketing Bulletin, 2, pp.66-70.

Hair, J.F., Black, W.C., Babin, B.J. and Anderson, R.E., 2014. Multivariate Data Analysis. 7th ed. USA: Pearson Education Limited.

Hair, J.F., Celsi, M., Money, A.H., Samouel, P. and Page, M.J., 2017. Essentials of business research methods. USA: Routledge.

Hair, J.F., Wolfinbarger, M., Bush, R.P. and Ortinau, D.J., 2013. Essentials of Marketing Research. 3rd ed. USA: McGraw-Hill Higher Education.

Chomeya, R., 2010. Quality of psychology test between Likert scale 5 and 6 points. Journal of Social Sciences, [e-journal] 6(3), pp.399-403. DOI: 10.3844/jssp.2010.399.403.

Ibrahim, Y.M., Hami, N. and Othman, S.N., 2019. Integrating sustainable maintenance into sustainable manufacturing practices and its relationship with sustainability performance: A conceptual framework. International Journal of Energy Economics and Policy, [e-journal] 9(4), pp.30-39. DOI: 10.32479/ijeep.7709.

Infante, C.E.D.., Mendonça, F.M.d., Purcidonio, P.M. and Valle, R., 2013. Triple bottom line analysis of oil and gas industry with multicriteria decision making. Journal of Cleaner Production, [e-journal] 52, pp.289-300. DOI: 10.1016/j.jclepro.2013.02.037.

Khattab, T.H. and Wahid, N.A., 2015. Penang User’s Perception of Domestic Water Quality, Health Risk Concern and Willingness to Pay: A Pilot Study. Jurnal Teknologi, [e-journal] 74(11), pp.93-107. DOI: 10.11113/jt.v74.4878.

Krosnick, J.A. and Fabrigar, L.R., 1997. Designing Rating Scales for Effective Measurement in Surveys. Survey Measurement and Process Quality, pp.141-164.

Kumar, R., 2011. Research Methodology: A Step-by-Step Guide for Beginners. 3rd ed. USA: SAGE Publications.

Kumar, R., 2014. Research Methodology: A Step-by-Step Guide for Beginners. 4th ed. USA: SAGE Publications.

Nunnally, J.C. and Bernstein, I., 1994. Psychometric Theory. 3rd ed. New York: McGraw-Hill.

OPEC (Organization of the Petroleum Exporting Countries), 2018. Annual Statistical Bulletin. [pdf] Vienna: OPEC. Available at: < http://www.thegulfintelligence.com/mediafiles/downloadfile/4833753a-f159-46f2-8dc0-f2335344ebe6.pdf > [Accessed 01 July 2020].

Oppenheim, A.N., 2000. Questionnaire Design, Interviewing and Attitude Measurement. USA: Bloomsbury Academic.

Pallant, J., 2011. Spss Survival Manual. 4th ed. New York: McGraw-Hill.

Paulraj, A., 2011. Understanding the relationships between internal resources and capabilities, sustainable supply management and organizational sustainability. Journal of Supply Chain Management, [e-journal] 47(1), pp.19-37. DOI: 10.1111/j.1745-493X.2010.03212.x.

Saunders, M., Lewis, P. and Thornhill, A., 2009. Research Methods for Business Students. 5th ed. UK: Prentice-Hall.

Saunders, M., Lewis, P. and Thornhill, A., 2016. Research Methods for Business Students. 7th ed. UK: Pearson Education Limited.

Sekaran, U. and Bougie, R., 2010. Research Methods For Business: A Skill Building Approach. 5th ed. UK: Wiley & Sons.

Sekaran, U. and Bougie, R., 2016. Research Methods For Business: A Skill Building Approach. 7th ed. UK: Wiley & Sons.

Schneider, J., Vargo, C., Campbell, D. and Hall, R., 2011. An Analysis of Reported Sustainability-Related Efforts in the Petroleum Refining Industry. The Journal of Corporate Citizenship, 44, pp.69-84. DOI: 10.9774/GLEAF.4700.2011.wi.00006.

Si, S.X. and Cullen, J.B., 1998. Response Categories And Potential Cultural Bias: Effects Of An Explicit Middle Point In Cross‐Cultural Surveys. The International Journal of Organizational Analysis, [e-journal] 6(3), pp.218-230. DOI: 10.1108/eb028885.

Thrulogachantar, P. and Zailani, S., 2011. The influence of purchasing strategies on manufacturing performance: An empirical study in Malaysia. Journal of Manufacturing Technology Management, [e-journal] 22(5), pp.641-663. DOI: 10.1108/17410381111134482.

UN-ESCWA (United Nations Economic and Social Commission for Western Asia), 2018. External Trade Bulletin Of The Arab Region. [pdf] New York: United Nations. Available at: < https://www.unescwa.org/recurring-publication-identifier/external-trade-bulletin-arab-region > [Accessed 01 July 2020].

Van Belle, G., 2008. Statistical Rules of Thumb. 2nd ed. UK: Wiley & Sons.

Zhu, Q. and Sarkis, J., 2004. Relationships between operational practices and performance among early adopters of green supply chain management practices in Chinese manufacturing enterprises. Journal of Operations Management, [e-journal] 22(3), pp.265-289. DOI: 10.1016/j.jom.2004.01.005.

Zikmund, W.G., Babin, B.J., Carr, J.C. and Griffin, M., 2013. Business Research Methods. 9th ed. USA: Cengage Learning.

DOI: http://dx.doi.org/10.12776/qip.v24i2.1385


  • There are currently no refbacks.

Copyright (c) 2020 Yousif M. Ibrahim, Norsiah Hami, Susan S. Abdulameer

ISSN 1335-1745 (print)
ISSN 1338-984X (online)
CCBY crossref cope
Covered, abstracted, indexed in:
Clarivate Analytics Emerging Sources Citation Index; Scopus; Google Scholar; IDEAS; EconPapers; RePEc; Cabells' Directories; Google Scholar