Embedding time-series plot of mne-qt-browser into our own GUI?

adam2392 · June 16, 2022, 3:21pm

If you have a question or issue with MNE-Python, please include the following info:

MNE version: 1.1+
operating system: macOS 12 / Windows 10 / Ubuntu 18.04

Please also provide relevant code snippets – ideally a minimal working example (MWE).

Hi,

I am interested in embedding an ICA component time-series plot into our own GUI. We would like the robust characteristics of the current mne-qt-browser.

Is it possible to use mne-qt-browser to plot an ICA time series?
Is it possible to extract a Widget from mne-qt-browser that contains the ICA time-series dynamic plot that we can then stick into our own GUI?
If it is possible, any idea how we would do this?

Reference code WIP: [ENH] Draft GUI for labeling components by adam2392 · Pull Request #66 · mne-tools/mne-icalabel · GitHub

cc: @mscheltienne @Richard @marsipu @larsoner who might know some.

larsoner · June 16, 2022, 7:05pm

Have you read

github.com/mne-tools/mne-qt-browser

Is it possible to embed MNEQtBrowser directly in PyQt UI>> QWidget/QFrame/QGraphicsScene/ Custom Widgets?

opened 04:43PM - 22 Apr 22 UTC

vsltech

E.G: I have added a basic Ui where I want to Embedded MNEQtBrowser into a QWidge…t/QFrame/QGraphicsView/QLayout whichever is possible? ![er1](https://user-images.githubusercontent.com/7692586/164757631-8cf39b39-c339-4136-a732-80653dd37565.PNG) Code Snippet to Run Ui: [graph.zip](https://github.com/mne-tools/mne-qt-browser/files/8542618/graph.zip) ``` from PyQt5 import QtCore,QtGui,QtWidgets, uic from PyQt5.QtWidgets import QFileDialog,QWidget, QLineEdit,QLabel, QApplication,QAction,QMainWindow,QMessageBox from PyQt5.QtCore import QThread, Qt, pyqtSignal, pyqtSlot,QRect, Qt ,QLine,QEvent from PyQt5.QtGui import QImage,QPixmap,QIcon,QPainter, QPen import sys,cv2,requests,uuid,os,csv from pathlib import Path import mne sample_dir = mne.datasets.sample.data_path() raw_path = Path(sample_dir) / 'MEG' / 'sample' / 'sample_audvis_raw.fif' raw = mne.io.read_raw(raw_path,preload=True) # ============================================================================ class Ui(QMainWindow): def __init__(self): super(Ui, self).__init__() uic.loadUi("graph.ui", self) ################################### self.cam1_stat = 0 self.label_list=[] self.fps=0 self.start_stat=False self.lan = "English" self.sc = "1" self.cam_url = None self.desktop = QApplication.desktop() self.screenRect = self.desktop.screenGeometry() self.w = self.screenRect.width() self.h = self.screenRect.height() ################################## ################################### fig = raw.plot(show=False) fig.update_plot_ui(1400,950,90) self.show() #fig = raw.plot(remove_dc=False,show=True,block=True,show_options=False,theme='dark',title=None,proj=False) #,bgcolor='gray',bad_color='lightgray') self.graphicsView.setLayout(fig) self.frame.setLayout(fig) self.stackedWidget.setLayout(fig) self.centralwidget.setLayout(fig) ####################################### #self.setWindowFlags(QtCore.Qt.FramelessWindowHint) self.move(0, 0) #self.setMaximumSize(self.w,self.h) self.show() #print(self.w,self.h) #self.showFullScreen() if __name__ == '__main__': app = QApplication(sys.argv) ex = Ui() #ex.show() sys.exit(app.exec_()) ``` **If not possible then what's the best way to do this but not using matplotlib?**

github.com/mne-tools/mne-realtime

How to implement MNE-Realtime with MNEQt-Browser or mne.io.plot() ?

opened 02:16PM - 27 Apr 22 UTC

vsltech

``` import os.path as op import subprocess import mne from mne.viz import pl…ot_events from mne.utils import running_subprocess from mne_realtime import FieldTripClient, RtEpochs info = mne.io.read_info('<myEEGFileInEDFFormat') event_id, tmin, tmax = 1, -0.2, 0.5 with FieldTripClient(host='localhost', port=1972,tmax=40, wait_max=5, info=info) as rt_client: rt_epochs = RtEpochs(rt_client, event_id, tmin, tmax, proj=None) rt_epochs.start() for ev in rt_epochs.iter_evoked(): epoch_data = ev.data #mne.io.raw.plot(show=True,block=True,show_options=False,theme='dark',title=None,proj=False) print(epoch_data) rt_epochs.stop() ``` I don't want to plot using matplotlib, any snippet on plot using PyQtGraph(MNEQtBrowser) ?

?

adam2392 · June 16, 2022, 7:17pm

I have not, but the first issue’s simple 3 liner looks promising!!

Thanks for linking

marsipu · June 17, 2022, 6:14am

Hey Adam,

do you mean ICA.plot_sources with ICA time series? That should be already implemented.

Extracting the Plot-Widget should be also possible too but maybe not straight-forward since it is embedded into the MNEQtBrowser with all its functions.

But this weekend in fact I wanted to work on separating the core data-plot from the other elements to facilitate independent usage.

Best wishes

Martin

richard · June 17, 2022, 6:24am

@adam2392 is this maybe something we should even have in the Qt browser proper?

adam2392 · June 17, 2022, 3:14pm

Hi @marsipu

Yes all I would like to do is add a single ICA time series at a time. Say there are 15 components, then I would like to show only 1 at a time.

Is the following 3 lines you mention here sufficient for that?

github.com/mne-tools/mne-qt-browser

Is it possible to embed MNEQtBrowser directly in PyQt UI>> QWidget/QFrame/QGraphicsScene/ Custom Widgets?

opened 04:43PM - 22 Apr 22 UTC

vsltech

E.G: I have added a basic Ui where I want to Embedded MNEQtBrowser into a QWidge…t/QFrame/QGraphicsView/QLayout whichever is possible? ![er1](https://user-images.githubusercontent.com/7692586/164757631-8cf39b39-c339-4136-a732-80653dd37565.PNG) Code Snippet to Run Ui: [graph.zip](https://github.com/mne-tools/mne-qt-browser/files/8542618/graph.zip) ``` from PyQt5 import QtCore,QtGui,QtWidgets, uic from PyQt5.QtWidgets import QFileDialog,QWidget, QLineEdit,QLabel, QApplication,QAction,QMainWindow,QMessageBox from PyQt5.QtCore import QThread, Qt, pyqtSignal, pyqtSlot,QRect, Qt ,QLine,QEvent from PyQt5.QtGui import QImage,QPixmap,QIcon,QPainter, QPen import sys,cv2,requests,uuid,os,csv from pathlib import Path import mne sample_dir = mne.datasets.sample.data_path() raw_path = Path(sample_dir) / 'MEG' / 'sample' / 'sample_audvis_raw.fif' raw = mne.io.read_raw(raw_path,preload=True) # ============================================================================ class Ui(QMainWindow): def __init__(self): super(Ui, self).__init__() uic.loadUi("graph.ui", self) ################################### self.cam1_stat = 0 self.label_list=[] self.fps=0 self.start_stat=False self.lan = "English" self.sc = "1" self.cam_url = None self.desktop = QApplication.desktop() self.screenRect = self.desktop.screenGeometry() self.w = self.screenRect.width() self.h = self.screenRect.height() ################################## ################################### fig = raw.plot(show=False) fig.update_plot_ui(1400,950,90) self.show() #fig = raw.plot(remove_dc=False,show=True,block=True,show_options=False,theme='dark',title=None,proj=False) #,bgcolor='gray',bad_color='lightgray') self.graphicsView.setLayout(fig) self.frame.setLayout(fig) self.stackedWidget.setLayout(fig) self.centralwidget.setLayout(fig) ####################################### #self.setWindowFlags(QtCore.Qt.FramelessWindowHint) self.move(0, 0) #self.setMaximumSize(self.w,self.h) self.show() #print(self.w,self.h) #self.showFullScreen() if __name__ == '__main__': app = QApplication(sys.argv) ex = Ui() #ex.show() sys.exit(app.exec_()) ``` **If not possible then what's the best way to do this but not using matplotlib?**

I guess there’s no easy way to render a single time-trace dynamically from a set of traces, so I would possibly need to “reconstruct” an ICA object in the background to plot again each time.

adam2392 · June 17, 2022, 3:14pm

Sorry what do you mean here? What’s QTBrowser “proper”?

marsipu · June 18, 2022, 7:50am

Is the following 3 lines you mention here sufficient for that?

To add MNEQtBrowser to another Application this should suffice. Though there will still be all other UI-elements (toolbar, scrollbars) visible. Just the plot would be self.mne.view (instance of BrowserView). But I don’t think you can create it without MNEQtBrowser at the moment.

I guess there’s no easy way to render a single time-trace dynamically from a set of traces, so I would possibly need to “reconstruct” an ICA object in the background to plot again each time.

Yes, that would probably the easiest way, while a more hackier solution involving modifying all relevant parameters and adding traces dynamically should be possible too but also more work.
Maybe if we refactor the plot BrowserView out of MNEQtBrowser we could also expose some developer API for adding traces, modifying number of shown channels, etc. … .
Since I am working on a similar project, I might suggest a PR about that in the next days.