Update: 2024-10-16 Total Visitors:Wechat Homepage |
Dendritic LearningQDNM: Quaternion Dendritic Neuron Model for Multivariate Financial Time Series Prediction
Qianrui Yu, Zihang Zhang,
Ziqian Wang,
Haotian Li,
Zhenyu Lei,
and
Shangce Gao
•
IEEE Transactions on Emerging Topics in Computational Intelligence
• Oct. 2024
Quaternion dendritic neuron model (QDNM) is a novel neuron model that can be applied to multivariate time-series prediction. It generalizes the original DNM model to the quaternion domain, combining the dendrite-like nonlinear calculation capabilities of DNMs with multidimensional feature integration and analysis capabilities of quaternion encoding to make the proposed model suitable to multivariate prediction tasks. And the BP algorithm for the model is derived in the framework of the quaternion algebra.
Last edited by Zhenyu Lei • 2024/10/19
MDPN: A Lightweight Multi-Dendritic Pyramidal Neuron Model with Neural Plasticity on Image Recognition
Yu Zhang,
Pengxing Cai,
Yanan Sun,
Zhiming Zhang,
Zhenyu Lei,
and
Shangce Gao
•
IEEE Transactions on Artificial Intelligence
• Sep. 2024
MDPN is a lightweight neural network architecture that simulates the dendritic structure of pyramidal neurons to improve image representation, emphasizing nonlinear dendritic computation and neuroplasticity. In comparison with the traditional feedforward network model, MDPN focused on the importance of a single neuron and redefined the function of each subcomponent. Experimental results verify the effectiveness and robustness of our proposed MDPN on 16 standardized image datasets. ADNS: Alternating Excitation-Inhibition Dendritic Computing for Classification
Jiayi Li,
Zhenyu Lei,
Zhiming Zhang,
Haotian Li,
Yuki Todo,
and
Shangce Gao
•
IEEE Transactions on Artificial Intelligence
• Jun. 2024
The ADNS is a novel neural network architecture that emulates the excitation and inhibition mechanisms found in biological neurons. This enhancement boosts the feature extraction and nonlinear computation capabilities of individual neurons, enabling them to construct multi-layer networks and making deep dendritic neuron models feasible. Experimental results show that our proposed ADNS significantly outperforms traditional models on 47 feature classification datasets and two image classification datasets, CIFAR-10 and CIFAR-100. DDNet: Dendritic Deep Learning for Medical Segmentation
Zhipeng Liu,
Zhiming Zhang,
Zhenyu Lei,
Masaaki Omura, Rong-Long Wang,
and
Shangce Gao
•
IEEE/CAA Journal of Automatica Sinica
• Mar. 2024
DDNet is a novel network that integrates biologically interpretable dendritic neurons and employs deep supervision during training to enhance the model's efficacy. To evaluate the effectiveness of the proposed methodology, comparative trials were conducted on datasets STU, Polyp, and DatasetB. The experiments demonstrate the superiority of the proposed approach. DVT: Dendritic Learning-Incorporated Vision Transformer for Image Recognition
Zhiming Zhang,
Zhenyu Lei,
Masaaki Omura, Hideyuki Hasegawa,
and
Shangce Gao
•
IEEE/CAA Journal of Automatica Sinica
• Feb. 2024
DVT is an innovative study introducing a Dendritic Learning-incorporated Vision Transformer, specifically designed for universal image recognition tasks inspired by dendritic neurons in neuroscience. The model's architecture incorporates highly biologically interpretable dendritic learning techniques, enabling DVT to excel in handling complex nonlinear classification problems. CDNM: Fully Complex-valued Dendritic Neuron Model
Shangce Gao,
MengChu Zhou,
Ziqian Wang,
Daiki Sugiyama, Jiujun Cheng, Jiahai Wang,
and
Yuki Todo
•
IEEE Transactions on Neural Networks and Learning Systems
• Apr. 2023
In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex XOR problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
Last edited by Zhenyu Lei • 2024/10/10
DSNDE: Improving Dendritic Neuron Model with Dynamic Scale-free Network-based Differential Evolution
Yang Yu,
Zhenyu Lei,
Yirui Wang,
Tengfei Zhang,
Chen Peng,
and
Shangce Gao
•
IEEE/CAA Journal of Automatica Sinica
• Jan. 2022
This paper develops a dynamic scale-free network-based differential evolution algorithm (DSNDE) to train the dendritic neuron model (DNM). Through experiments on 14 benchmark datasets and a photovoltaic power forecasting problem, and compared with 9 meta-heuristic algorithms, the effectiveness of DSNDE is verified. The results show that DSNDE has better performance in most cases. DNM: Dendritic Neuron Model with Effective Learning Algorithms for Classification, Approximation, and Prediction
Shangce Gao,
MengChu Zhou,
Yirui Wang,
Jiujun Cheng, Hanaki Yachi, and Jiahai Wang
•
IEEE Transactions on Neural Networks and Learning Systems
• Feb. 2019
We develop a new dendritic neuron model (DNM) by considering the nonlinearity of synapses, not only for a better understanding of a biological neuronal system but also for providing a more useful method to address the ANN's difficulties of understanding and training. To achieve its better performance for solving problems, six learning algorithms are for the first time used to train it. The experiments on 14 different problems involving classification, approximation, and prediction are conducted by using a multilayer perceptron and the proposed DNM. The results suggest that the proposed learning algorithms are effective and promising for training DNM and thus make DNM more powerful in solving classification, approximation, and prediction problems. |