Services

Assessment & Evaluation

We provide assessment and evaluation services for proposals and grants. Please contact Mary Besterfield-Sacre and Larry Shuman for more information. The following are assessment instruments and references associated with measuring different aspects of engineering student learning.  Please contact Drs. Mary Besterfield-Sacre or Larry Shuman prior to using an instrument. Note web versions are available for all instruments.

The following two papers provide our overarching philosophy regarding assessment and measuring students’ learning.

  • Besterfield-Sacre, M. and LJ Shuman. “The Future of Assessment.” Designing Better Engineering Education Through Assessment: A Practical Resource for Faculty and Department Chairs on Using Assessment and ABET Criteria to Improve Student Learning, edited by Spurlin, J., Rajala, S., & Lavelle, J., 307-327.  Sterling, Va: Stylus Publishing (2008).
  • Shuman, L.J., M. Besterfield-Sacre, and J. McGourty. “The ABET ‘Professional Skills’ – Can they be Taught? Can they be Assessed?” Journal of Engineering Education 94, no 1 (2005): 41 - 55. 
     

Senior Engineering Capstone

Engineering Ethical Understanding

NSF DUE 0127394 Assessing Engineering Students’ Understanding of Their Professional and Ethical Responsibilities

The Pittsburgh-Mines (P-M) Engineering Ethics Assessment Rubric 

References  

  • Shuman, LJ, ME Besterfield-Sacre and BM Olds. “Ethics Assessment Rubrics.” Encyclopedia of Science, Technology, and Ethics, edited by Mitcham, C., L. Arnhart, D. Johnson and R. Spiers. Macmilliam (Spring 2005).
  • Shuman, LJ, B. Olds, M. Besterfield-Sacre, H. Wolfe, M. Sindelar, R. Miller and R. Pinkus, “Using Rubrics to Assess Students’ Ability Resolve Ethical Dilemmas,” Proceedings of the Industrial Engineering Research Conference, Atlanta, GA, May 2005.
  • Shuman, LJ, M. Sindelar, M. Besterfield-Sacre, H. Wolfe, R. Pinkus, RL Miller, B. Olds, and C. Mitcham, “Can Our Students Recognize and Resolve Ethical Dilemmas?” Proceedings of the American Society for Engineering Education Annual Conference, Salt Lake City, June 2004.
  • Mark Sindelar, Larry Shuman, Mary Besterfield-Sacre, Ronald Miller, Carl Mitcham, Barbara Olds, Rosa Pinkus and Harvey Wolfe, “Assessing Engineering Students’ Abilities To Resolve Ethical Dilemmas,” Proceedings, 2003 Frontiers in Education Conference, Boulder, CO, November, 2003. 
     

Self Efficacy in Engineering Modeling

NSF DUE 0717801 Collaborative Research: Improving Engineering Students' Learning Strategies Through Models and Modeling

See www.modelsandmodeling.net for additional resources on modeling and measuring engineering modeling

EMSE – Engineering Modeling Self-Efficacy Instrument  

References 

  • Yildirim, T.P., M. Besterfield-Sacre, L. Shuman, “An Engineering Modeling Self-efficacy (EMSE) Scale,” Proceedings of the 117th Annual Conference of American Society for Engineering Education, Louisville, Kentucky, June 20-23, 2010.
  • Yildirim, T.P., M. Besterfield-Sacre, and L. Shuman.  “The Impact of Self-efficacy on Students’ Ability to Create Models.” Proceedings of the 2010 Industrial Engineering Research Conference, Cancun, Mexico, June 5 – 9, 2010.

Knowledge Integration

NSF EEC-9872498 Engineering Education: Assessment Methodologies And Curricula Innovations

Concept Map Scoring Rubric  

References 

  • McCarthy, J.J., R.S. Parker, A. Abatan, and M. Besterfield-Sacre. “Evaluating an Integrated Curriculum in Chemical Engineering, Advances in Engineering Education 2, no 4 (2011): 1-22.
  • Besterfield-Sacre, M., J. Gerchak, M. Lyons, L.J. Shuman, and H. Wolfe. “Scoring Concept Maps: Development of an Integrated Rubric for Assessing Engineering Education.” Journal of Engineering Education 93, no 2 (April 2004): 105 – 116.

     

Freshmen Engineering Attitudes

EiF98.4 Perception vs. Performance: The Effects of Gender and Ethnicity across Engineering Schools

Pittsburgh Freshman Engineering Attitudes Survey and Weights for Attitude Measures 

References(Additional references available at request)

  • Besterfield-Sacre, M.E., M. Moreno, L.J. Shuman, and C.J. Atman, “Gender and Ethnicity Differences in Freshmen Engineering Student Attitudes: A Cross-Institutional Study,” Journal of Engineering Education, 90(4), October 2001, pp. 477 - 489.
  • Besterfield-Sacre, ME, Atman, CJ, and Shuman, LJ, “Engineering Student Attitudes Assessment,” Journal of Engineering Education, 87(2), April 1998, pp. 133-141.
  • Besterfield-Sacre, M.E., C.J. Atman and L.J. Shuman, “Characteristics of Freshman Engineering Students: Models for Determining Student Attrition and Success in Engineering,” The Journal of Engineering Education, 86(2), April 1997, pp. 139-149.
  • Moreno, M., M.E. Besterfield-Sacre, L.J. Shuman, H. Wolfe, and C.J. Atman, “Self-Assessed Confidence in EC-2000 Outcomes: A Study of Gender and Ethnicity Differences Across Institutions,” Proceedings of the 2000 Frontiers in Education Conference, Kansas City, MO., October 19-21, 2000 (CD ROM - 6 pgs.).
  • Besterfield-Sacre, M., M. Moreno, L.J. Shuman, and C.J. Atman, “Comparing Entering Freshman Engineers: Institutional Differences in Student Attitudes,” 1999American Society for Engineering Education Conference Proceedings, Charlotte, NC, June 20-23,1999, (CD-ROM - 12 pgs.).
  • Besterfield-Sacre, M.E., N.Y. Amaya, L.J. Shuman, C.J. Atman, and R. Porter. “Understanding Student Confidence as it Relates to First Year Achievement,” 1998 Frontiers in Education Conference

Entrepreneurship and Mindset

NSF DUE-0817394 Collaborative Research: Assessing Technical Entrepreneurship Learning in Engineering Education

Engineering Knowledge Inventory (EKI) and Entrepreneurship Mindset (please contact Dr. Besterfield-Sacre for a copy)

References (Additional references available at request)

  • Besterfield-Sacre, M.E., N. Ozaltin, L. Shuman, A. Shartrand, and P. Weilerstein, “Understanding the Technical Entrepreneurship Landscape,” 118th Annual American Society of Engineering Education Conference, Vancouver, BC, June 26-29, 2011. 
  • Shartrand, A., P. Weilerstein, M. Besterfield-Sacre, and K. Golding. “Technology Entrepreneurship Programs in U.S. Engineering Schools: An Analysis of Programs at the Undergraduate Level.” 2010 ASEE Annual Conference, Louisville, KY,  June 20-23, 2010.
  • Shartrand, A., P. Weilerstein, M. Besterfield-Sacre, and B. Olds. “Two Tools for Assessing Student Learning in Technology Entrepreneurship.” 38that the ASEE/IEEE Frontiers in Education Conference, Saratoga Springs, NY, October 22-25, 2008.
     

Design Process Maps

NSF CBET-0602592 Collaborative Research: The BME-IDEA Competition, Assessing Innovative Design in Biomedical Engineering Education

Please contact Dr. Besterfield-Sacre for instructions and copy of design activities

References (Additional references available at request)

  • Golish, B., M. Besterfield-Sacre, L. Shuman. “Comparing the Innovation Processes in Academic and Corporate Settings.” Journal of Product Innovation Management 25, no 1 (2008): 47-62.
  • Streiner, S, C. Deibler, M Besterfield-Sacre, and L. Shuman (2010). “Design Process Maps: A Look at Team Dynamics”, Proceedings of the 2010 Industrial Engineering Research Conference, Cancun Mexico, June 5-9, 2010. 
  • Besterfield-Sacre, M., L.J. Shuman, P. Weilerstein, and A. Shartrand.  “Bioengineering Process Maps: Elements Used to Produce Innovative Designs.” Winner of Best Paper Award for the Biomedical Divisionat the 2009 Annual Conference & Exposition, Austin, TX, June 14 – 17, 2009.
     

Monitoring Innovative Design Process

NSF CBET-0602592 Collaborative Research: The BME-IDEA Competition, Assessing Innovative Design in Biomedical Engineering Education

Please contact Dr. Besterfield-Sacre for instructions and copy of design activities

References (Additional references available at request)

  • Ozaltin, N., M. Besterfield-Sacre, and LJ Shuman.  “A Conceptual Model to Understand Innovation in the Design Process.” Proceedings of the 2010 Industrial Engineering Research Conference, Cancun, Mexico, June 5-9, 2010. 
  • Ozaltin, N., M. Besterfield-Sacre, and L.J. Shuman.  “Bioengineering Design Process: Patterns That Lead to Quality Outcomes.” 2010 ASEE Annual Conference, Louisville, KY,  June 20-23, 2010.