Mental Process Errors in Intelligence Analysis and Methods for Mitigation
DOI:
https://doi.org/10.5281/zenodo.21076774Keywords:
Intelligence, Intelligence Analysis, Structured Analysis Techniques, Prejudice, Alternative ThinkingAbstract
This study examines the mental process errors observed in intelligence analysis and methods developed to combat them, focusing on analysis as a fundamental component of intelligence activities. The central problem is the question, "What are the mental process errors observed in intelligence work?" Literature reviews show analytical techniques have been developed to reduce such errors. Therefore, a secondary question is also added: "Which techniques can be used to prevent analytical errors?" This question increases the comprehensiveness and holistic character of the study. Using qualitative data analysis and document analysis methods, books, articles, theses, reports, and institutional documents were examined to gather data answering the research questions. Three fundamental mental process errors were identified in intelligence analysis processes: complexity and uncertainty, domain expertise, and bias. Biases are further divided into cultural, organizational, and cognitive biases, while cognitive biases are examined in greater detail. The study emphasizes that these errors arise not only from individual limitations, but also from institutional routines, information overload, and ambiguous security environments. Techniques developed to combat cognitive errors are grouped into three categories: diagnostic methods, oppositional methods, and creative methods. Each category includes four analytical techniques, resulting in a total of 12 techniques being examined. The aim is to demonstrate how these methods are applied, their contributions to intelligence analysis, and their strengths and weaknesses. In this respect, the study links cognitive error types with structured analytic techniques. It also argues that improving intelligence analysis requires an analytical culture that encourages questioning, alternative thinking, and systematic self-criticism.
Three fundamental mental process errors were identified in intelligence analysis processes. These are the concepts of “complexity and uncertainty,” “domain expertise,” and “bias.” Biases are further subdivided into cultural biases, organizational biases, and cognitive biases, with cognitive biases also examined separately. Techniques developed to combat these cognitive errors are grouped into three categories: diagnostic methods, oppositional methods, and creative methods. Each of these methods includes four analytical techniques, and their application is demonstrated. In the October 7th attack, the mistakes made by Israeli intelligence are evaluated under three headings: reliance on technology, failure to identify Hamas' intentions and capabilities, and general analytical errors.
References
Acar, Ü. (2016). Polisin istihbarata yaklaşımı. In S. Yılmaz (Ed.), Dünyayı yöneten güç: İstihbarat bilimi (ss. 155–172). Kripto Yayınları.
Anadolu Ajansı. (2024, April 4). İsrail'in hedeflerini yapay zekânın seçtiği ortaya çıktı. https://www.aa.com.tr/tr/teyithatti/blog/israilin-hedeflerini-yapay-zekanin-sectigi-ortaya-cikti/1817606
Ard, M. J. (2023). Structured analytic techniques: A pragmatic approach. International Journal of Intelligence and CounterIntelligence, 37(2), 617–633.
Artner, S., Girven, S. R., & Bruce, J. B. (2016). Assessing the value of structured analytic techniques in the U.S. intelligence community. RAND Corporation.
Atay, M. (1996). Stratejik ulusal güvenlik istihbaratı. Strateji Dergisi, (1), 80–84.
Spellman, B. A. (2011). Individual reasoning. In B. Fischhoff & C. Chauvin (Eds.), Intelligence analysis: Behavioral and social scientific foundations (pp. 117–142). National Academies Press.
Bennet, A., & Bennet, D. (2004). Organizational survival in the new world: The intelligent complex adaptive system. Butterworth-Heinemann.
Bergman, R., & Goldman, A. (2023, November 30). Israel knew Hamas's attack plan more than a year ago. The New York Times. https://www.nytimes.com/2023/11/30/world/middleeast/israel-hamas-attack-intelligence.html
Chang, W., Chen, E., Mellers, B., & Tetlock, P. E. (2016). Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments. Judgment and Decision Making, 11(5), 509–526. https://doi.org/10.1017/S1930297500004599
Coulthart, S. (2016). Why do analysts use structured analytic techniques? An in-depth study of an American intelligence agency. Intelligence and National Security, 31(7), 933–948. https://doi.org/10.1080/02684527.2016.1140327
Coulthart, S. J. (2017). An evidence-based evaluation of 12 core structured analytic techniques. International Journal of Intelligence and CounterIntelligence, 30(2), 368–391.
Çencen, N. (2023). Yapılandırılmış istihbarat analiz teknikleri bağlamında şeytanın avukatlığı analiz tekniğinin değerlendirilmesi (Yayımlanmamış yüksek lisans tezi). Jandarma ve Sahil Güvenlik Akademisi.
Çencen, N. (2024). İstihbaratta yöntemler: Yapılandırılmış analiz teknikleri ve şeytanın avukatlığı. Yeditepe Yayınları.
Çencen, N., & Kocamanoğlu, S. (2024). Yapılandırılmış istihbarat analiz tekniklerinden kırmızı takım (şapka) analizinin önemi üzerine bir bakış. SDE Akademi Dergisi, 4(3), 387–404. https://doi.org/10.58375/sde.1536930
Çencen, N., Kocamanoğlu, S., & Berk, M. B. (2022). Structured intelligence analysis techniques: An assessment of the importance of indicators or signposts of change analysis technique. SDE Akademi Dergisi, 2(4), 104–128.
Davis, J. (1991). Combating mind-set: Improving the quality of analysis. Studies in Intelligence. https://www.cia.gov/library/center-for-the-study-of-intelligence/kent-csi/vol35no4/html/v35i4a03p_0001.htm
Director of National Intelligence. (2015). Vision 2015: A globally networked and integrated intelligence enterprise. https://www.dni.gov/files/documents/Newsroom/Reports%20and%20Pubs/Vision_2015.pdf
Fingar, T. (2011). Reducing uncertainty: Intelligence analysis and national security. Stanford University Press.
Gill, P., & Phythian, M. (2018). Intelligence in an insecure world (2nd ed.). Polity Press.
Grunt, P. (2017). Structured analytic techniques: Taxonomy and technique selection for information and intelligence analysis practitioners. Journal of Management and Financial Sciences, (30), 115–136.
Gül, H. (2025). Bilginin kıymetlendirilmesinde düşünmenin rolü: İstihbarat analizi ve eleştirel düşünme. Güvenlik Çalışmaları Dergisi, 27(1), 95–122.
Hahn, U., & Harris, A. J. L. (2014). What does it mean to be biased? Motivated reasoning and rationality. In B. H. Ross (Ed.), Psychology of learning and motivation (Vol. 61, pp. 41–102). Academic Press.
Hall, W. M., & Citrenbaum, G. (2010). Intelligence analysis: How to think in complex environments. Praeger.
Handel, M. I. (1977). The Yom Kippur War and the inevitability of surprise. International Studies Quarterly, 21(3), 461–502.
Harris, D. H., & Spiker, V. A. (2012). Critical thinking skills for intelligence analysis. In K. St. Amant & S. Still (Eds.), Intelligence analysis (pp. 209–232). IntechOpen. https://www.intechopen.com/chapters/35820
Havle, N., & Aksoy, S. (2024). Bilişsel bariyerlerden kurumsal yönetime: İstihbarat topluluklarında önyargı yönetimi. Telakki Sosyal Bilimler Dergisi, 3(5), 263–288.
Hedley, J. H. (2007). The challenges of intelligence analysis. In L. K. Johnson (Ed.), Strategic intelligence: Understanding the hidden side of government (pp. 123–138). Praeger Security International.
Heuer, R. J. (1978). Quantitative approaches to intelligence analysis. Westview Press.
Heuer, R. J. (1999). Psychology of intelligence analysis. Center for the Study of Intelligence, Central Intelligence Agency.
Heuer, R. J. (2005). Limits of intelligence analysis. Orbis, 49(1), 75–94. https://doi.org/10.1016/j.orbis.2004.10.003
Heuer, R. J. (2008, March 26–29). Taxonomy of structured analytic techniques. Paper presented at the International Studies Association Annual Convention, San Francisco, CA, United States.
Jensen, M. A. (2012). Intelligence failures: What are they really and what do we do about them? Intelligence and National Security, 27(2), 261–282. https://doi.org/10.1080/02684527.2012.661641
Jervis, R. (2006). Reports, politics, and intelligence failures: The case of Iraq. Journal of Strategic Studies, 29(1), 3–52. https://doi.org/10.1080/01402390500431599
Johnson, L. K. (1996). Analysis for a new age. Intelligence and National Security, 11(4), 657–671.
Johnson, L. K. (2010). National security intelligence. In L. K. Johnson (Ed.), The Oxford handbook of national security intelligence (pp. 3–32). Oxford University Press.
Kent, S. (2003). Stratejik istihbarat (Y. Özbek & N. Şüküroğlu, Çev.). ASAM Yayınları. (Orijinal eser 1949'da yayımlanmıştır.)
Küçükbaş, H. (2015). Bilgi yönetimi yaklaşımlarındaki değişimin istihbarat analizine etkisi (Yayımlanmamış yüksek lisans tezi). Harp Akademileri Komutanlığı.
Lowenthal, M. M. (1985). The burdensome concept of failure. In A. C. Maurer, M. D. Tunstall, & J. M. Keagle (Eds.), Intelligence: Policy and process (pp. 51–64). Westview Press.
Lowenthal, M. M. (2009). Intelligence: From secrets to policy (4th ed.). CQ Press.
McGlynn, P., & Garner, G. (2019). Intelligence analysis fundamentals. Routledge.
Mitchell, G. R. (2006). Team B intelligence coups. Quarterly Journal of Speech, 92(2), 144–173. https://doi.org/10.1080/00335630600816990
Moore, D. T., & Krizan, L. (2003). Core competencies for intelligence analysis at the National Security Agency. In R. G. Swenson (Ed.), Bringing intelligence about: Practitioners reflect on best practices (pp. 95–132). Joint Military Intelligence College.
National Research Council. (2011). Intelligence analysis: Behavioral and social scientific foundations. National Academies Press.
NATO. (2017). NATO alternative analysis handbook (2nd ed.). Allied Command Transformation. https://www.act.nato.int/wp-content/uploads/2023/05/alta-handbook.pdf
Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220. https://doi.org/10.1037/1089-2680.2.2.175
Pherson, R. H., & Heuer, R. J. (2011). Structured analytic techniques for intelligence analysis. CQ Press.
Phythian, M. (2009). Intelligence analysis today and tomorrow. Security Challenges, 5(1), 67–83.
Prunckun, H. (2010). Handbook of scientific methods of inquiry for intelligence analysis. Scarecrow Press.
Şahin, İ. (2020). Bilişsel süreçlerin istihbarat analizi performansına etkisi: Küba Füze Krizi örneği (Yayımlanmamış yüksek lisans tezi). İstanbul Aydın Üniversitesi.
Thompson, J. R., et al. (1984). The cognitive bases of intelligence analysis. U.S. Army Institute for the Behavioral and Social Sciences.
U.K. Ministry of Defence, Development, Concepts and Doctrine Centre. (2021). Red teaming guide (3rd ed.). https://assets.publishing.service.gov.uk/media/61702155e90e07197867eb93/20210625-Red_Teaming_Handbook.pdf
U.S. Department of the Army. (2009). Training Circular 2-33.4: Intelligence analysis. Department of the Army.
U.S. Government. (2009). A tradecraft primer: Structured analytic techniques for improving intelligence analysis. https://info.publicintelligence.net/TradecraftPrimer.pdf
Yılmaz, S. (2006). 21. yüzyılda güvenlik ve istihbarat. Milenyum Yayınları.
Yılmaz, S. (2018). Temel istihbarat. Kripto Yayınları.
Zhaohong, J. (2015). Illuminating human biases in the intelligence cycle. Pointer: Journal of the Singapore Armed Forces, 41(2), 19–31.
Zohar, E. (2013). Intelligence analysis as a manifestation of a grounded theory. International Journal of Intelligence and CounterIntelligence, 26(1), 130–160. https://doi.org/10.1080/08850607.2012.705072
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ömer Faruk ÇELİK

This work is licensed under a Creative Commons Attribution 4.0 International License.
