The Hack.lu/CTI-Summit once again allowed us to get in touch with the community and sit down to talk about new features and issues to be implemented. As usual, it was a real pleasure to get that much concentrated feedback. In this release, we put a lot of effort trying to fix and create new content as much as possible based on the collected needs of the community.
Based on a set of fixes including a security fix, we are pleased to announce the immediate availability of MISP 2.4.198. You can find a list of the detailed changes along with new features further below. As with any security release, we highly encourage everyone to update their instance as soon as possible.
Config Option: Added a new configuration option user_org_uuid_in_response_header to include a response header with the requesting user’s organization UUID. [Jeroen Pinoy]
Build: Display required STIX dependencies versions during the build process. [Jakub Onderka]
Bookmark now supports comment.
Changes
Version: Version bump. [iglocska]
Warning List: Updated the warning list. [Alexandre Dulaunoy]
Taxonomies: Updated to the latest version. [Alexandre Dulaunoy]
MISP Galaxy: Updated to the latest version. [Alexandre Dulaunoy]
PyMISP: Version bump. [Raphaël Vinot]
Internal Logging: Added logging when an event will not be published. [Jakub Onderka]
Global Menu - Bookmarks: Added comment field as the dropdown element’s title in the global menu bookmark. [Sami Mokaddem]
Database Upgrade - Bookmarks: Upgraded the database to support bookmark comments. [Sami Mokaddem]
Bookmark View: Added a missing comma for the new comment function and added a field for comments in the bookmark view. [Jan Z.]
Bookmark Index: Added a field to display comments in the bookmarks index. [Jan Z.]
Bookmark Add/Edit: Added a field to add and edit comments for bookmarks. [Jan Z.]
MISP Object: Updated to the latest version. [Alexandre Dulaunoy]
Fixes
UI/Footer: Improved UI footer to avoid confusion for some users. [Alexandre Dulaunoy]
IOC Import: Added a check to ensure the provided XML is valid. [Jakub Onderka]
Schema: Updated schema version. [Jakub Onderka]
UI: Fixed tag popover to return already parsed data. [Jakub Onderka]
Bookmarks - Add: Lower-cased the comment field. [Sami Mokaddem]
Sightings: Correctly retrieve sightings per the requested event. [Tom King]
Bookmarks - Verbose Returns: Fixed an issue with overly verbose returns from bookmarks when shared with the organization. This fix was reported by Sharad Kumar Dahal of Green Tick Nepal Pvt. Ltd. [iglocska] This fixes a security issue recorded as CVE-2024-45509.
Feed: When pulling feeds, events are now checked against specified rules if any rules are provided. [Benni0]
Other
Merged pull requests addressing issues with unpublished events logging, tag popover parsing, sightings restSearch performance, and STIX dependencies version display. [Jakub Onderka, Andras Iklody, Andrew Hicks]
Fixed issues related to sightings restSearch negation of organization ID. [Andrew Hicks]
For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!
MISP 2.4.196 released with many bugs fixed and improvements.
New Features
Decaying Model: Introduced a new DecayingModel that leverages true positive and false positive sightings for better decision-making. [Marcel Slotema]
Log Search Enhancement: Added an optional hh:mm:ss accuracy to log searches, allowing for more precise time-based queries. This update also includes significant refactoring to improve code quality. [iglocska]
User Log Review: Improved the functionality of the “review user logs” button. It now links directly to logs relevant to the specific user, considering the new audit log system. Future enhancements will include email-based log searches. [iglocska]
Changes
PyMISP Update: Updated PyMISP to the latest version. [Raphaël Vinot]
Decaying Model Formulas: Enhanced error handling by catching undefined indexes in decaying model formulas. [Sami Mokaddem]
Attributes Search: Added support for sorting by publish_timestamp and introduced the X-Skipped-Elements-Count header to improve pagination during REST searches. [Benni0]
Reverse Proxy Handling: Fixed issues with base URL handling for reverse proxies, eliminating problematic redirects. Special thanks to Mitch Germansky for the extensive debugging. [iglocska]
MISP Components Update: Updated MISP Object, Galaxy, and STIX components to their latest versions. [Alexandre Dulaunoy, Christian Studer]
Fixes
STIX 2 Import: Updated the STIX 2 parsers following recent changes in MISP-STIX. [Christian Studer]
Base URL Setting: Adjusted the priority order in beforeFilter to avoid redis errors during benchmarking. [iglocska]
Image Helper: Allowed for variable-width organization logos without overlapping text. [iglocska]
Workflow Module: Ensured correct type return if redis fails to load during workflow:getEnabledModules. [Sami Mokaddem]
Settings Management: Fixed multiple issues related to changing instance settings, including improvements to CLI checks. [iglocska]
Attribute Search Ordering: Reverted ID-based sliding window ordering due to performance concerns. [iglocska]
Other
Merged several development branches to integrate recent changes, updates, and fixes from various contributors. Notably, the branches related to attribute search order, skipped elements count, and environment dependencies were integrated into the main branch. [iglocska, Christian Studer, Sami Mokaddem, Alexandre Dulaunoy, Stefano Ortolani, Andras Iklody]
For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!
Design and Execute Cyber Threat Intelligence Scenarios with SkillAegis
Practical experience is essential for skill development, and effective training must be both engaging and capable of identifying gaps in understanding. That’s why we’re pleased to launch version 1.0.0 of SkillAegis, your new training companion.
We are pleased to announce the immediate availability of MISP v2.4.195, a summer release aiming to introduce new features, fix a long list of reported bugs and deficiencies as well as give your servers a breather in the scorching summer heat by taking a load off your CPUs thanks to a set of impactful performance fixes.
Many organizations run MISP instances with other cybersecurity tools and OSINT for data-driven investigations. Investigators can integrate both internal and external data to map with MISP data in various ways. This blog details how to look up information directly in the MISP community using MISP Transforms on Maltego Graph, highlighting its seamless integration for efficient and comprehensive investigations.
The JTAN (Joint Threat Analysis Network) Project, co-funded by the European Union’s CEF program, addresses the critical need for efficient and effective threat intelligence sharing among cybersecurity teams. As cyber threats grow in complexity and scale, the ability to quickly exchange and analyze threat data across organizations has become essential for maintaining robust security.
MISP 2.4.194 released with new functionalities and various bugs fixed.
New Features
Bookmark Functionality:
Users can now create bookmarks.
Bookmarks can be shared with all users in the same organization.
Heartbeat Endpoint:
New /users/heartbeat endpoint.
Accessible without authentication; returns a 200 response to indicate the instance is operational.
Designed for quick checks to see if the instance is up and running.
Skip OTP Requirement:
New role permission to exclude certain roles from OTP requirements.
Useful for filtered, local service accounts.
Users API Update:
Added a new boolean field indicating whether TOTP is set up for the user.
Applicable to /users/view, /admin/users/view, /admin/users/index endpoints.
Changes
Various Version Bumps:
Updates for misp-stix, schema, PyMISP, warning-lists, misp-galaxy, and misp-objects.
Bookmark Improvements:
Added title documentation for the exposed_to_org field.
Enhanced quick search support for bookmarks.
ACL and Schema Updates:
Heartbeat added to the ACL component.
Updates to schema and mysql.sql.
Fixes
Default Roles and Permissions:
Added delegation permission for sync user and publisher roles.
Readded default roles.
Fixed issues with PyMISP tests, default roles, and various editor and ingestion bugs.
UI and Functional Fixes:
Corrected event report markdown editor to display tags.
Included user agent in feed ingestion to address issues with specific feeds.
Fixed editing view for galaxycluster blocklist.
Readded missing org logo in the decaying model.
Corrected JSON response handling in the decaying tool.
Fixed object reference links for proper view refocus.
Corrected errors in the server edit view.
Fixed typo in bookmark description.
Adjusted default role settings in mysql.sql.
Updated local flag in EventTags to be boolean.
Corrected filenames in RHEL background worker migration guide.
Improved performance by increasing chunk size for sighting sync.
For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!
We are excited to announce the release of MISP v2.4.190. This latest version introduces a slew of new features, improvements, and fixes designed to streamline operations and enhance security measures for our users.
Kunai is an open-source security monitoring tool, specifically designed to address the threat-hunting and threat-detection problematic on Linux. It has been inspired by Microsoft Sysmon, to provide a Sysmon alike experience to the end user. However, it comes with some more advanced features such as fine grained event filtering, detection rules and IoC matching. In this blog post, we are going to introduce how to implement real time MISP IoC matching in a very short amount of time.
The MISP Project, renowned for its threat intelligence sharing platform, and Yeti Platform, the Forensics Intelligence platform supporting CTI and DFIR practitioners, are coming together to create a more robust and interconnected open source landscape.
We are pleased to announce the immediate release of MISP 2.4.188, with major performance improvements and many bugs fixed.
New Features
Datasource Improvements:
Updates to some datasources with the ignoreIndexHint parameter (mysqlExtended, mysqlObserverExtended).
Fix for forceIndexHint.
Settings:
Added setting to temporarily disable the loading of sightings via the API (affects restsearch and /events/view endpoints). This helps with performance issues caused by large sighting data sets.
Changes
PyMISP:
Multiple version bumps.
Version and Internal Updates:
General version bump.
Improved error handling and marking BadRequestException as fail log in CI.
Attempt to fix a failing test.
Updated misp-galaxy, misp-object, and warning-lists.
Attribute Search Rework:
Significant performance improvement when using MysqlExtended or MysqlObserverExtended data sources.
Event level lookup moved to subqueries for faster queries.
Ignoring the deleted index to improve speed.
OpenAPI Updates:
Added content for analyst-data and event-reports.
Sighting Policy Support:
Added support of sighting policy in sightings:getLastSighting.
Attribute Search Performance:
Improved performance of includeDecayScore by a factor of 5.
Attribute Fetch Refactor:
Simplified conditions and optimizations.
Fixes
Attribute Search:
Enforced unpublishedprivate directive.
Internal Error Handling:
Error handling improvements in AttachmentScan.
CurlClient HEAD Request:
Added CURLOPT_NOBODY for HEAD requests.
CLI and ECS Updates:
Fix for redisReady in dragonfly.
Change type from Exception to Throwable in ECS.
OIDC:
Default organization handling if not provided by OIDC.
Publishing and Sync Issues:
Fix for publishing and sync errors.
Performance Improvements:
Bulk loading of analyst data to speed up event loading.
UI Update:
Added MISP.email_reply_to to server config.
Other
Multiple merges of branches and updates.
Fixes and changes in misp-stix, attachment scan error handling, OIDC default org handling, alert email titles, shadow attribute handling, and community additions (ICS-CSIRT.io).
Community and Contribution Updates
Additions and changes to the community, including the introduction of the ICS-CSIRT.io community.
Poppy a new Bloom filter format and open source library
Introduction
At CIRCL we use regularly bloom filters for some of our use cases especially in digital forensic. Such as providing a small, fast and shareable caching mechanism for Hashlookup database which can be used by incident responders.