Homeproj: Redmine for CESNET: Issueshttps://homeproj.cesnet.cz/https://homeproj.cesnet.cz/httpauth-login/favicon.ico?16194486082024-03-21T15:00:23ZHomeproj: Redmine for CESNET
Redmine Mentat - Bug #7721 (New): The email about filter change doesn't have a Czech translation https://homeproj.cesnet.cz/issues/77212024-03-21T15:00:23ZRajmund HruškaMentat - Config #7719 (New): In GitLab CI/CD GeoLite2 databases are downloaded for almost every job https://homeproj.cesnet.cz/issues/77192024-03-19T16:03:44ZRajmund Hruška
<p>This could result in reaching the daily limit and subsequently failing of the pipeline.</p>
<p><a class="external" href="https://gitlab.cesnet.cz/713/mentat/mentat/-/jobs/18036">https://gitlab.cesnet.cz/713/mentat/mentat/-/jobs/18036</a></p> Mentat - Support #7717 (New): Add tests for more Hawat endpointshttps://homeproj.cesnet.cz/issues/77172024-03-19T14:34:22ZJakub Judiny
<p>Most of the Hawat endpoints are not covered with tests. We should add at least basic tests using keywords.</p> Mentat - Bug #7716 (New): In some cases, API returns html contenthttps://homeproj.cesnet.cz/issues/77162024-03-19T12:23:39ZJakub Maloštik
So far, what we're aware of:
<ul>
<li>During maintenance</li>
<li>When API is called with an expired user session</li>
</ul> Mentat - Bug #7712 (New): Errors are emailed twicehttps://homeproj.cesnet.cz/issues/77122024-03-14T13:49:08ZRajmund Hruška
<p>Email 1:<br /><pre><code class="python syntaxhl"><span class="n">Message</span> <span class="nb">type</span><span class="p">:</span> <span class="n">ERROR</span>
<span class="n">Location</span><span class="p">:</span> <span class="o">/</span><span class="n">var</span><span class="o">/</span><span class="n">mentat</span><span class="o">/</span><span class="n">venv</span><span class="o">/</span><span class="n">lib</span><span class="o">/</span><span class="n">python3</span><span class="p">.</span><span class="mi">11</span><span class="o">/</span><span class="n">site</span><span class="o">-</span><span class="n">packages</span><span class="o">/</span><span class="n">hawat</span><span class="o">/</span><span class="n">base</span><span class="p">.</span><span class="n">py</span><span class="p">:</span><span class="mi">201</span>
<span class="n">Module</span><span class="p">:</span> <span class="n">base</span>
<span class="n">Function</span><span class="p">:</span> <span class="n">log_exception</span>
<span class="n">Time</span><span class="p">:</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">03</span><span class="o">-</span><span class="mi">11</span> <span class="mi">16</span><span class="p">:</span><span class="mi">39</span><span class="p">:</span><span class="mi">56</span><span class="p">,</span><span class="mi">771</span>
<span class="n">Message</span><span class="p">:</span>
<span class="nb">Exception</span> <span class="n">on</span> <span class="o">/</span><span class="n">groups</span><span class="o">/</span><span class="mi">5</span><span class="o">/</span><span class="n">show</span><span class="err">?</span> <span class="p">[</span><span class="n">GET</span><span class="p">]</span>
<span class="n">Traceback</span> <span class="p">(</span><span class="n">most</span> <span class="n">recent</span> <span class="n">call</span> <span class="n">last</span><span class="p">):</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">2529</span><span class="p">,</span> <span class="ow">in</span> <span class="n">wsgi_app</span>
<span class="n">response</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">full_dispatch_request</span><span class="p">()</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1825</span><span class="p">,</span> <span class="ow">in</span> <span class="n">full_dispatch_request</span>
<span class="n">rv</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">handle_user_exception</span><span class="p">(</span><span class="n">e</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1823</span><span class="p">,</span> <span class="ow">in</span> <span class="n">full_dispatch_request</span>
<span class="n">rv</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">dispatch_request</span><span class="p">()</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1799</span><span class="p">,</span> <span class="ow">in</span> <span class="n">dispatch_request</span>
<span class="k">return</span> <span class="bp">self</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="bp">self</span><span class="p">.</span><span class="n">view_functions</span><span class="p">[</span><span class="n">rule</span><span class="p">.</span><span class="n">endpoint</span><span class="p">])(</span><span class="o">**</span><span class="n">view_args</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask_login/utils.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">290</span><span class="p">,</span> <span class="ow">in</span> <span class="n">decorated_view</span>
<span class="k">return</span> <span class="n">current_app</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="n">func</span><span class="p">)(</span><span class="o">*</span><span class="n">args</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/views.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">107</span><span class="p">,</span> <span class="ow">in</span> <span class="n">view</span>
<span class="k">return</span> <span class="n">current_app</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="bp">self</span><span class="p">.</span><span class="n">dispatch_request</span><span class="p">)(</span><span class="o">**</span><span class="n">kwargs</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/hawat/view/__init__.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1344</span><span class="p">,</span> <span class="ow">in</span> <span class="n">dispatch_request</span>
<span class="bp">self</span><span class="p">.</span><span class="n">do_before_response</span><span class="p">()</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/hawat/blueprints/groups/__init__.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">258</span><span class="p">,</span> <span class="ow">in</span> <span class="n">do_before_response</span>
<span class="k">raise</span> <span class="nb">Exception</span><span class="p">(</span><span class="s">'Test error'</span><span class="p">)</span>
<span class="nb">Exception</span><span class="p">:</span> <span class="n">Test</span> <span class="n">error</span>
</code></pre></p>
<p>Email 2:<br /><pre><code class="python syntaxhl">
<span class="n">Message</span> <span class="nb">type</span><span class="p">:</span> <span class="n">CRITICAL</span>
<span class="n">Location</span><span class="p">:</span> <span class="o">/</span><span class="n">var</span><span class="o">/</span><span class="n">mentat</span><span class="o">/</span><span class="n">venv</span><span class="o">/</span><span class="n">lib</span><span class="o">/</span><span class="n">python3</span><span class="p">.</span><span class="mi">11</span><span class="o">/</span><span class="n">site</span><span class="o">-</span><span class="n">packages</span><span class="o">/</span><span class="n">hawat</span><span class="o">/</span><span class="n">base</span><span class="p">.</span><span class="n">py</span><span class="p">:</span><span class="mi">511</span>
<span class="n">Module</span><span class="p">:</span> <span class="n">base</span>
<span class="n">Function</span><span class="p">:</span> <span class="n">eh_internal_server_error</span>
<span class="n">Time</span><span class="p">:</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">03</span><span class="o">-</span><span class="mi">11</span> <span class="mi">16</span><span class="p">:</span><span class="mi">39</span><span class="p">:</span><span class="mi">56</span><span class="p">,</span><span class="mi">783</span>
<span class="n">Message</span><span class="p">:</span>
<span class="n">INTERNAL</span> <span class="n">SERVER</span> <span class="n">ERROR</span>
<span class="n">Request</span><span class="p">:</span> <span class="o">/</span><span class="n">groups</span><span class="o">/</span><span class="mi">5</span><span class="o">/</span><span class="n">show</span><span class="err">?</span>
<span class="n">Traceback</span><span class="p">:</span>
<span class="n">Traceback</span> <span class="p">(</span><span class="n">most</span> <span class="n">recent</span> <span class="n">call</span> <span class="n">last</span><span class="p">):</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">2529</span><span class="p">,</span> <span class="ow">in</span> <span class="n">wsgi_app</span>
<span class="n">response</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">full_dispatch_request</span><span class="p">()</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1825</span><span class="p">,</span> <span class="ow">in</span> <span class="n">full_dispatch_request</span>
<span class="n">rv</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">handle_user_exception</span><span class="p">(</span><span class="n">e</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1823</span><span class="p">,</span> <span class="ow">in</span> <span class="n">full_dispatch_request</span>
<span class="n">rv</span> <span class="o">=</span> <span class="bp">self</span><span class="p">.</span><span class="n">dispatch_request</span><span class="p">()</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/app.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1799</span><span class="p">,</span> <span class="ow">in</span> <span class="n">dispatch_request</span>
<span class="k">return</span> <span class="bp">self</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="bp">self</span><span class="p">.</span><span class="n">view_functions</span><span class="p">[</span><span class="n">rule</span><span class="p">.</span><span class="n">endpoint</span><span class="p">])(</span><span class="o">**</span><span class="n">view_args</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask_login/utils.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">290</span><span class="p">,</span> <span class="ow">in</span> <span class="n">decorated_view</span>
<span class="k">return</span> <span class="n">current_app</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="n">func</span><span class="p">)(</span><span class="o">*</span><span class="n">args</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/flask/views.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">107</span><span class="p">,</span> <span class="ow">in</span> <span class="n">view</span>
<span class="k">return</span> <span class="n">current_app</span><span class="p">.</span><span class="n">ensure_sync</span><span class="p">(</span><span class="bp">self</span><span class="p">.</span><span class="n">dispatch_request</span><span class="p">)(</span><span class="o">**</span><span class="n">kwargs</span><span class="p">)</span>
<span class="o">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/hawat/view/__init__.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">1344</span><span class="p">,</span> <span class="ow">in</span> <span class="n">dispatch_request</span>
<span class="bp">self</span><span class="p">.</span><span class="n">do_before_response</span><span class="p">()</span>
<span class="n">File</span> <span class="s">"/var/mentat/venv/lib/python3.11/site-packages/hawat/blueprints/groups/__init__.py"</span><span class="p">,</span> <span class="n">line</span> <span class="mi">258</span><span class="p">,</span> <span class="ow">in</span> <span class="n">do_before_response</span>
<span class="k">raise</span> <span class="nb">Exception</span><span class="p">(</span><span class="s">'Test error'</span><span class="p">)</span>
<span class="nb">Exception</span><span class="p">:</span> <span class="n">Test</span> <span class="n">error</span>
</code></pre></p> Mentat - Feature #7708 (New): Host info modulehttps://homeproj.cesnet.cz/issues/77082024-02-27T14:02:51ZJakub Judiny
<p>Hosts module will be removed in <a class="issue tracker-2 status-1 priority-3 priority-lowest" title="Feature: Get rid of hosts module (New)" href="https://homeproj.cesnet.cz/issues/7703">#7703</a>. However, it could be useful to keep an utility, that would display information from all data sources available (DNS, PassiveDNS, Nerd, GeoIP...) about an IP in one page. This would only be a GUI thing, no new functionality would be added.</p> Mentat - Feature #7707 (New): All fields in search form should have negationshttps://homeproj.cesnet.cz/issues/77072024-02-20T14:59:22ZJakub Judiny
<p>Now only fields that are selected have a negation option ("not_detectors" etc.), but this should also be the case for fields with user input (such as Description). These fields should also be visible for all users and not just hidden in the URL.</p>
<p>Based on input from Pavla Hlučková.</p>
<p>Example use cases:<br />- Searching for events, that do not have "Test" category.<br />- Searching for events of particular event class (or category), that are from other detectors than "detector1". This can be useful when trying to correctly set parameters of an event class, because you want to see events from all different detectors that send events labelled with this event class.<br />- Searching for events that do not have a specific description.</p> Mentat - Feature #7706 (New): Users should be able to choose which information about events shoul...https://homeproj.cesnet.cz/issues/77062024-02-20T14:55:28ZJakub Judiny
<p>Now there are fixed fields displayed in the event search (detected at, sources, severity, category, detector and abuse group). But it could be useful to allow users to choose which fields (e.g. description, port, protocol) should be displayed there instead - this could be helpful when searching for something specific, that cannot be specified through our form.</p>
<p>Based on input from Pavla Hlučková.</p>
<p>Example use case: I want to see description (or other field not displayed there by default) of the searched events without needing to open them all, which could save a lot of time and clicks.</p> Mentat - Feature #7705 (New): Event search should support "any value" and "without value" for abu...https://homeproj.cesnet.cz/issues/77052024-02-20T14:35:18ZJakub Judiny
<p>Now it is not possible to only search events with assigned abuse group. It should be possible, because we support these options for other fields such as protocols, detectors, severities etc. This would enable users to search internal events only.</p>
<p>Based on input from Pavla Hlučková.</p> Mentat - Feature #7702 (New): CSAG should keep query parameters from formhttps://homeproj.cesnet.cz/issues/77022024-01-25T10:40:46ZJakub Judiny
<p>When using context search from within a narrowed down context (e.g., timeline of a single host address) the new search link is only constricted to the used variable and other constrictions set by the user for the initial search are ignored.</p>
<p>It would also be great if CSAG event search had explicit detect time set, because now is implicit, which is not user friendly (it is not clear that it searches only in events from last 7 days).</p> Mentat - Bug #7696 (New): Scripts in bin folder are not located in any directory specified in $PA...https://homeproj.cesnet.cz/issues/76962023-11-27T14:06:39ZRajmund Hruška
<p>Using <code>setuptools</code> (keyword <code>scripts</code>), the scripts available in <code>bin</code> folder should be executable from the command line [1]. This worked in the past, but nowadays, the new scripts are not located in <code>/usr/local/bin</code> as before. More specifically, the new links are not created.</p>
<p>Based on the date, this might be related to <a class="issue tracker-5 status-5 priority-4 priority-default closed" title="Task: Use Vagrant as alternative tool for local development (Closed)" href="https://homeproj.cesnet.cz/issues/7041">#7041</a>.</p>
<p>[1] <a class="external" href="https://python-packaging.readthedocs.io/en/latest/command-line-scripts.html#the-scripts-keyword-argument">https://python-packaging.readthedocs.io/en/latest/command-line-scripts.html#the-scripts-keyword-argument</a></p> Mentat - Bug #7694 (New): When showing timeline based on storage time restriction, only results w...https://homeproj.cesnet.cz/issues/76942023-11-23T15:20:07ZJakub Maloštik
<p>When detect time is not present, its values for the timeline view default to showing last week. This might mean that no results are found even though there are some events shown in the event view.</p> Mentat - Feature #7691 (New): Allow for configurable company identity and personal data processin...https://homeproj.cesnet.cz/issues/76912023-11-06T10:17:05ZPavel Káchaph@cesnet.cz
<p>On account registration it's usual (and nowadays necessary) to at least show some URL to personal data processing legislative verbiage/privacy policy, so the user is properly informed before providing that information. It's now solved by custom patch, however we could add some optional configuration keys, for example for instance logo, instance name (possible company name), instance info link (possible company link) and link to privacy policy.</p> Mentat - Task #7689 (New): Node.js setup_XX.x installation script is deprecatedhttps://homeproj.cesnet.cz/issues/76892023-10-30T10:08:41ZRajmund Hruška
<p>When building the virtual machine from scratch using <code>vagrant up</code>, the building stops for 60 seconds.</p>
<p><a class="external" href="https://github.com/nodesource/distributions/discussions/1639">https://github.com/nodesource/distributions/discussions/1639</a><br /><a class="external" href="https://github.com/nodesource/distributions/blob/69a45587cd87bd8c700e40bb8a8160e0c28d71d8/README.md#installation-instructions">https://github.com/nodesource/distributions/blob/69a45587cd87bd8c700e40bb8a8160e0c28d71d8/README.md#installation-instructions</a></p> Mentat - Bug #7681 (Feedback): There are no detectors on Hubhttps://homeproj.cesnet.cz/issues/76812023-08-29T15:56:50ZJakub Judiny
<p><a class="external" href="https://mentat-hub.cesnet.cz/mentat/detectors/list">https://mentat-hub.cesnet.cz/mentat/detectors/list</a></p>
<p>Even on Alt, many detectors are missing and the last detector was created 8 months ago.</p>
<p>So if someone clicks on "View details of detector DETECTOR" in context menu, 404 Not found is shown to the user.</p>