• Skip to primary navigation
  • Skip to content
  • Skip to footer
slgotting
      • general
        • Fantasy Football
      • house renovation
        • Drywall
      • Woodworking
        • Finish
      • Android Studio
        • General
      • AI
        • Data Ingestion
        • Pytorch Transfer Learning
        • Model Layers
        • Callbacks
        • Saving - Loading
        • Search Algorithms
        • Data Normalization
        • Imports
        • Classification
        • Numpy Data Processing
        • Optimizer Functions
        • Graphing
        • Optimizing Models
        • Speech Recognition
        • Weights & Biases
        • Pytorch Saving And Loading
        • Make Predictions
        • General
        • Debugging
        • Loss Functions
        • Activation Functions
      • Arduino
        • D1 Mini
        • FAQ
        • ESP32-CAM
        • Libraries
        • Web Server
        • ESP8266
        • SPIFFS - LittleFS
      • python
        • testing
        • base64
        • wheels
        • sys os
        • Scripting
        • dict
        • Virtual Environments (venv)
        • gunicorn
        • imports
        • Profiling
        • timeit
        • requests
        • Images
        • Parse JSON
        • celery
        • pandas
        • Email
        • datetime
        • Logging
        • SQL
      • angular
        • Components
        • generate
        • In Memory Data
        • Routing
      • protocols
        • FTP
      • van life
        • Electricity
        • Dodge Repair Notes
        • Information
      • programming
        • markdown
        • regex examples
      • cad
        • OpenSCAD
      • hardware
        • Memory
      • databases
        • mongo
        • MySQL
        • Postgres
      • security
        • Burp Suite
        • Recon
        • Reverse Shells
        • Upload Vulns
        • nmap
        • Keylogging
        • Permissions
        • XSS
        • Authentication
        • Hash cracking
        • BeEF
        • Password Cracking
        • Metasploit
        • XXE
        • Scanning
        • CSRF
        • SSRF
        • WiFi
        • SQLi
        • Tools
        • Subdomain Enumeration
        • Other Cheatsheets
        • JWT
        • Priviledge Escalation
        • Initial Access
      • php
        • Installation
      • web development
        • Jekyll
        • General Helpers
        • Security Threats
        • CSS
        • Tailwind
        • AJAX
        • Flask
        • Javascript
        • Svelte
      • linear algebra
        • numpy
        • Symbols
      • Pressure Washing
        • Legality
        • Automation
        • Checklists
        • Equipment
        • Maintenance
        • Starting Out Mistakes
        • Essentials
        • Chemicals
      • nutrition
        • Potassium
      • robotics
        • ROS2 - Gazebo - Unity
        • Gears
        • Components
        • Arduino
        • Fastener Info
        • Electricity Equations
      • trading
        • VMC
      • solidity ethereum
        • Compilation
        • General
        • Gotchas
      • art - design
        • GIMP
        • Blender
        • Figma
        • SVG
        • Wacom Tablet (Ubuntu)
      • youtube
        • Thumbnail
        • Video
        • Video Naming
      • miscellaneous
        • Selling Points
        • Deployment Pros Cons
        • Temporary Notes
        • Deployment Notes
        • Youtube
      • svelte
        • Capacitor
        • Props
      • automation
        • wmctrl
        • xdotool
      • health and fitness
        • Sinuses
        • Rotator Cuff
        • Exercise
      • Data Visualization
        • matplotlib
      • virtual box
        • Virtual Box Commands
      • search engines
        • Google
      • web assembly
        • C - C++
      • Crossreferenced Tables
        • Array Operation Mapping
      • covid-19
        • Arguments
      • Image Manipulation
        • Resize Images
      • C - C++
        • Pointers
        • Syntax
        • Documentation
        • Mongoose
        • Compilation
        • Input - Output
        • Data Types
        • Debugging
      • internet browsers
        • History
      • dev ops
        • Considerations
        • Git
        • Digital Ocean
        • Docker Compose
        • Kubernetes
        • Docker
        • Github Actions
      • machinery
        • Pressure washer
      • personal
        • Quotes
        • Measurements
        • Bauer20v
      • javascript
        • RxJS
        • Paths - Files
        • JSDoc
      • linux
        • rsync
        • awk
        • cron
        • jq
        • bash
        • grep
        • SSH - SCP
        • env
        • gif
        • sed
        • Searching
        • chmod
        • libcurl
        • Network
        • Dates And Times
        • bandwidth
        • Audio and Recording
        • history
        • nginx
        • Security
        • emacs
        • Tools
        • General
        • gpg
        • USB
        • System Information
        • Processes
        • backups
        • ffmpeg
      • VPN
        • Mullvad

      Classification - AI

      On this page

      • Steps to take when optimizing a classification neural net
      • Intermediate hidden neural network layers

      Steps to take when optimizing a classification neural net

      1. Set activation function to softmax
      2. Set loss function to categorical cross entropy
      3. Normalize data
      
              

      Intermediate hidden neural network layers

      Most of the time use ReLU
      ReLU simply truncates the negative values
      
              
      • Twitter
      © 2024 Steven Gotting