AI-Based Evaluation and Testing Assignment
Introduction to Computer Security
Computer Science, Spring 2025
For this assignment, you will be evaluating and testing the access control model you created in the previous module.
By incorporating AI-driven feedback, you will refine your strategy, making it more resilient and practical, while also developing skills in assessing and integrating AI-generated content.
To enhance the evaluation of your access control model, incorporate AI-driven evaluation in the following way:
Predictive Analysis Using AI
Submit your proposed access control policy to an AI chatbot.
Ask the AI to identify 3-4 potential weaknesses or areas where security breaches might occur.
Document the feedback received and explain which suggestions you integrated and which you ignored, providing rationales.
Submission Requirements
A document containing your reflection and analysis of the AI-based evaluation.
- The document would be around 2-4 pages total.
- Please clearly indicate which AI tool you’ve chosen and provide the URL if it is an external AI tool.
- Please include relevant screenshots or copied quotations directly from the AI chat text as useful to support your analysis. You do not need to provide an entire copy of the interaction—just segments integrated into your reflection that support your own analysis.
- At the end of the document, provide details of how you will plan to revise your policy if the AI interaction provided useful ideas.
Assessment Criteria
Just as a reference, you can take into consideration the following criteria:
Clarity and Structure: Logical organization and clarity of explanation.
Depth of Analysis: Justification of chosen access control model and detailed role assignments.
Security Considerations: Addressing potential threats and mitigation strategies.
AI Integration and Reflection: Thoughtful explanation of how you will refine the model based on insights from the exercises that demonstrates critical thinking in evaluating the feedback
Responsible AI Use
To help protect privacy and minimize security risks when using AI chatbots, consider the following best practices:
- Avoid sharing personal or sensitive information. Do not input personally identifiable details or confidential institutional data, including specifics about the organization used in this exercise. Before uploading any documents, ensure your name and other identifying information are removed.
- Review the chatbot’s privacy policies. Familiarize yourself with how the AI platform collects, stores, and manages data, including its policies on data retention, third-party sharing, and ownership.
- Adjust settings for enhanced privacy. Some AI tools (e.g., ChatGPT and Claude) offer options to prevent user inputs from being used for model training. Enabling these settings can help protect your data.