A Study of the Relationship between the Consistency of Self- and Other-Evaluation, Attitudes toward Evaluation Feedback and Leadership Behavior Change Intention

Abstract
This study sought to investigate the current situation of the consistency of self- and other-evaluation in elementary school principals’ leadership effectiveness and the difference between different consistencies in attitudes toward evaluation feedback and behavior change intention; to discuss the relationship between elementary school principals’ attitudes toward evaluation feedback and their behavior change intention; and to examine the predictive relationship of the consistency of elementary school principals’ leadership effectiveness evaluation and attitudes toward evaluation feedback on behavior change intention.The 783 people, including education bureau officials, principals, teachers, and parents, were picked to conduct leadership effectiveness evaluation on 87 elementary school principals based on the ideas and methods of 360 degree feedback. After turning the original scores into z-scores, self- and other-evaluation results were compared and divided into the four categories of overestimation, underestimation, in-agreement/good and in-agreement /poor. In the current research, the results of self- and other-evaluation were mailed to the 87 principals along with the Questionnaire of Attitudes toward Evaluation Feedback and the Questionnaire of Leadership Behavior Change Intention. With 79 valid questionnaires returned, One-Way ANOVA, Pearson Product Moment Correlation and Multiple Regression Analysis were used for statistical analyses.This study gained important findings as follows: Elementary school principals show high-intermediate approval in attitudes toward overall evaluation feedback and high approval in leadership behavior change intention. There is no significant difference between elementary school principals with different consistencies of self- and other-evaluation in either attitudes toward evaluation feedback or behavior change intention. Elementary school principals’ attitudes toward evaluation feedback and behavior change intention are highly correlated. The consistency of self- and other-evaluation and attitudes toward evaluation feedback can effectively predict principals’ leadership behavior change intention; attitudes toward evaluation feedback have the best predictability, reaching 54.8 percent.

Keywords
Leadership Effectiveness, 360 Degree Feedback, Consistency of Self- and Other-Evaluation, Attitudes toward Evaluation Feedback, Behavior Change Intention

Cite this paper
Tsai-Feng Cheng, Lung-An Shen, Ping-Yun Chen, Yie-jen Wu, A Study of the Relationship between the Consistency of Self- and Other-Evaluation, Attitudes toward Evaluation Feedback and Leadership Behavior Change Intention , SCIREA Journal of Education. Volume 7, Issue 5, October 2022 | PP. 149-172. 10.54647/education88378

References

[ 1 ]	Alammar, L. (2015). The effective school: The role of the leaders in school effectiveness. Educational Research and Reviews, 10(6), 695-721.
[ 2 ]	Amundsen, S., & Martinsen, L. (2014). Self-other agreement in empowering leadership: Relationships with leader effectiveness and subordinates’ job satisfaction and turnover intention. Leadership Quarterly, 25(4), 784-800.
[ 3 ]	Atwater, L. E., Waldman D. A., Atwater, D., & Cartier, P. (2000). An upward feedback field experiment: Supervisors’ cynicism, reactions, and commitment to subordinates. Personnel Psychology, 53, 275-297.
[ 4 ]	Atwater, L., & Yammarino, F.（1992）. Does self-other agreement on leadership perception moderate the validity of leadership and performance prediction? Personnel Psychology, 45, 141-164.
[ 5 ]	Atwater, L., & Yammarino, F. (1997). Self-other rating agreement：A review and model. Research in Personnel and Human Resource Management, 15, 121-174.
[ 6 ]	Bass, B., & Yammarino, F. (1991). Congruence of self and others’ leadership rating of naval officers for understanding successful performance. Applied Psychology：An International Review, 40, 437-454.
[ 7 ]	Bergner, S., Davda, A., Culpin, V., & Rybnicek, R. (2016). Who overrates, who underrates? Personality and its link to self–other agreement of Leadership Effectiveness. Journal of Leadership & Organizational Studies. 23(3), 335-354.
[ 8 ]	Bernardin, H. J., Dahmus, S. A., & Redmon, G. (1993). Attitudes of first-line supervisors toward subordinate appraisals. Human Resource Management, 32, 315-324.
[ 9 ]	Bracken, D. W., & Church, A. H. (2013). The “new” performance management paradigm: Capitalizing on the unrealized potential of 360 degree feedback. People & Strategy, 36(2), 34-40.
[ 10 ]	Bracken, D. W., & Rose, D. S. (2011). When does 360-degree feedback create behavior change? And how would we know it when it does? Journal Business Psychology, 26, 183-192.
[ 11 ]	Braddy, P. W., Gooty, J., Fleenor, J. W., & Yammarino, F. (2014). Leader behaviors and career derailment potential: A multi-analytic method examination of rating source and self–other agreement. Leadership Quarterly, 25(2), 373-390.
[ 12 ]	Brett J, F., & Atwater, L. (2001). 360 feedback: Accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology, 86, 930-942.
[ 13 ]	Brown, A., Lin, Y., & Inceoglu, I. (2017). Preventing rater biases in 360-degree feedback by forcing choice. Organizational Research Methods. 20(1), 121-148.
[ 14 ]	Byrd, B., Martin, C., Nichols, C., & Edmondson, A. (2015). Examination of the quality and effectiveness of peer feedback and self-reflection exercises among medical students. Federation of American Societies for Experimental Biology Journal, 29, 1.
[ 15 ]	Cacioppe, R. L., & Albrecht, S. L. (2000). Using 360 degree feedback and the integral model to develop leadership and management skills. Leadership & Organization Development Journal , 21(8), 390-404.
[ 16 ]	Cheng, T. F. (2006). The indicator construction and measure of principals’ competing values leadership effectiveness: Questionnaire design and empirical research from the perspective of behavioral complexity. Kaohsiung: Fu Wen.
[ 17 ]	Cheng, T. F. (2007). A study on school principals’ competing values leadership effectiveness: Theory, indicator and assessment. Taipei: Higher Education.
[ 18 ]	Cheng, T. F. (2012). A study on the senior high vocational school principals’ competing values leadership effectiveness indicators constructed and their relationships with behavior change intention based on 360 degree evaluation system. National Science Council (NSC 98-2511-S-017- 002-MY3).
[ 19 ]	Cheng, T. F., & Wu, H. C. (2009). A study of the relationships among evaluations of elementary school principals’ competing values leadership effectiveness, attitudes towards 360 degree feedback and their behavior change intention. Education Policy Forum, 12(2), 177-217.
[ 20 ]	Church, A. H. (1997). Managerial self-awareness in high-performing individuals in organizations. Journal of Applied Psychology, 82, 281-292.
[ 21 ]	Day, D. V. , Fleenor, J. W., Atwater, L .E. Sturm, R. E., & McKee, R. A. (2014). Advances in leader and leadership development: A review of 25 years of research and theory. The Leadership Quarterly, 25, 63-82.
[ 22 ]	Day, D. V., & Dragoni, L. (2015). Leadership development: An outcome-oriented review based on time and levels of analyses. Annual Review of Organizational Psychology and Organizational Behavior, 2, 133-156.
[ 23 ]	Deshpande, S., Bhanot, A., & Maknikar, S. (2015). Assessing the influence of a 360-degree marketing communications campaign with 360-degree feedback. Social Marketing Quarterly, 21(3), 142-151.
[ 24 ]	Facteau, J. D., Facteau, C. L., McGonigle, T. P. & Fredholm, R. L. (1999). Characteristics of rating and managers' reactions to multisource performance feedback. Journal of Organizational Behavior, 18, 225-237.
[ 25 ]	Fleenor, J. W., & Prince, J. M. (1997). Using 360-degree feedback in organization. Center for creative leadership. North Carolian: Greensbolo.
[ 26 ]	Fleenor, J., Taylor, S., & Chappelow, C. (2008). Leveraging the impact of 360-degree feedback. San Francisco: Pfeiffer.
[ 27 ]	Folger, R. (1987). Reformulating the preconditions of resentment：A referent conditions model. In J. C. Masters & W. P. Smith (Eds), Social comparison, relative deprivation and social justice: Theoretical, empirical, and policy, perspectives (pp.39-68). New York: Pleumm Press.
[ 28 ]	Frauman, T. (2013). Augmenting effective performance management with 360 degree feedback. Asia Pacific Coatings Journal, 26(5), 34-36.
[ 29 ]	Furnham, A., & Stringfield, P. (1998). Congruence in job-performance ratings: A study of 360° feedback examining self, manager, peers, and consultant ratings. Human Relations, 51, 517-530.
[ 30 ]	Gumustekin, G. E., Ozler D. E. C., & Yilmaz, F. (2010). A research to determining the impact of 360 degree performance evaluation system on organizational commitment. Business and Economics Research Journal, 1(1), 1-20.
[ 31 ]	Hammerly, M. E., Harmon, L., & Schwaitzberg, S. D. (2014). Good to great: Using 360-degree feedback to improve physician emotional intelligence. Journal of Healthcare Management. 59(5), 354-365.
[ 32 ]	Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32, (2-3), 325-351.
[ 33 ]	Hsu, C. W. (2000). The study of using 360-degree feedback to explore the factors affecting behavior change intention of managers.
[ 34 ]	Karkoulian, S., Assaker, G., & Hallak, R. (2016). An empirical study of 360-degree feedback, organizational justice, and firm sustainability. Journal of Business Research. 69(5), 1862-1867.
[ 35 ]	Kinicki, A. J., Prussia, G. E., Wu, B., & McKee-Ryan, F. M. (2004). A covariance structure analysis of employees’ response to performance feedback. Journal of Applied Psychology, 89(6), 1057-1069.
[ 36 ]	Kopperud, K. H., Martinsen, Ø., & Humborstad, S. I. W. (2015). Engaging leaders in the eyes of the beholder: On the relationship between transformational leadership, work engagement, service climate, and self-other agreement. Journal of Leadership & Organizational Studies, 21(1), 29-42.
[ 37 ]	Latham, G. P., & Wexley, N. (1994). Increasing productivity through performance appraisal grending. MA: Addison-Wesley.
[ 38 ]	Leithwood, K., & Jantzi, D. (2008). Linking leadership to student learning: The contributions of leader efficacy. Educational Administration Quarterly, 44, 496-528.
[ 39 ]	Lepsinger, R., & Lucia, A. D. (2009). The art and science of 360 degree feedback (2nd Ed). San Francisco, CA: Jossey-Bass.
[ 40 ]	Markham, S. E., Markham, I. S., & Smith, J. W. (2015). At the crux of dyadic leadership: Self–other agreement of leaders and direct reports analyzing 360-degree feedback. Leadership Quarterly, 26(6), 958-977.
[ 41 ]	Markham, S. E., Markham, I. S., & Smith, J. W. (2017). A review, analysis, and extension of peer-leader feedback agreement: Contrasting group aggregate agreement vs. self-other agreement using entity analytics and visualization. Leadership Quarterly, 28(1), 153-177.
[ 42 ]	McDonald, A. R. (1997). Intention to use feedback in single and multi-source performance appraisal systems. A dissertation submitted to the University at Albany in Partial Fulfillment of the Requirement for the Degree of Doctor of Philosophy.
[ 43 ]	McKee, R. A., Yih-teen L., & Antonakis, J. (2015). Effects of personality and gender on self-other agreement in ratings of transformational leadership. Academy of Management Annual Meeting Proceedings, 2015(1), 1-1.
[ 44 ]	Mishra, G. (2014). An exploratory study of the process and problems of 360-degree feedback in select IT companies. Compensation & Benefits Review, 46(2), 116- 122.
[ 45 ]	Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal. Thousand Oaks, CA: Sage.
[ 46 ]	Nowack, K., & Mashihi, S. (2012). Evidence-based answers 15 questions about leveraging 360-degree feedback. Consulting Psychology Journal: Practice & Research, 64(3), 157-182.
[ 47 ]	Orr, M.T., & Orphanos, S. (2011). How graduate-level preparation influences the effectiveness of school leaders: A comparison of the outcomes of exemplary and conventional leadership preparation programs for principals. Educational Administration Quarterly, 47(1), 18-70.
[ 48 ]	Quinn, R. E., & McGrath, M. R. (1985). The transformation of organizational cultures: A competing values perspective. In P .J. Frost, L. F. Moore, M. L. Louis, C. C. Lundberg, & J. Martin (Eds.). Organizational culture (pp.315-334). Beverly Hills, CA: Sage.
[ 49 ]	Robinson, V. M. J., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44, 635-674.
[ 50 ]	Sergiovanni, T. J. (1995). The principalship: A reflective practice perspective (3rd ed.). Boston: Allyn and Bacon.
[ 51 ]	Smither, J. W., & Reilly, S. P. (2001). Coaching in organizations: A social psychological perspective. In M. London (Ed.), How people evaluate others in organizations (pp. 221–252). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
[ 52 ]	Smither, J. W., London, M., & Reilly, M. (2005). Does performance improve following multi-source feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology, 58, 33-66.
[ 53 ]	Taylor, M. S., Fisher, C. D., & Ilgen, D. R. (1984). Individual’s reactions to performance feedback in organization: A control theory perspective. In K. M. Rowland and G. R. Ferris (Eds.), Research in personnel and human resources management (pp.81-124). Greenwich, CT: JAI Press.
[ 54 ]	Taylor, S., & Todd, P. (1995). Assessing IT usage: The role of prior experience. MIS Quarterly, 19(4), 561-570.
[ 55 ]	Tornow, W. (1993). Perception or reality: Is multi-perceptive measurement a means or an end? Human Resource Management, 32, 221-230.
[ 56 ]	Tosti, D. T., & Addison, R. M. (2009). 360-degree feedback: Going around in circles? Performance Improvement, 48(3), 36-39.
[ 57 ]	Van Velsor E., Taylor, S., & Leslie, J.（1993）. An examination of the relationships among self-perception accuracy, self-awareness, gender, and leader effectiveness. Human Resource Management, 32, 249-264.
[ 58 ]	Waldman, D. A., & Bowen, D. E. (1998). The acceptability of 360- degree appraisals: A customer-supplier relationship perceptive. Human Resource Management, 37, 117-129.
[ 59 ]	Yukl, G. (2013). Leadership in organization. Englewood Cliffs, NJ: Prentice-Hall.