dc.contributor.author | Kelleher, John | |
dc.date.accessioned | 2022-03-21T10:59:30Z | |
dc.date.available | 2022-03-21T10:59:30Z | |
dc.date.issued | 2020 | |
dc.date.submitted | 2020 | en |
dc.identifier.citation | Mahalunkar A., Kelleher J.D. (2020) Mutual Information Decay Curves and Hyper-parameter Grid Search Design for Recurrent Neural Architectures. In: Yang H., Pasupa K., Leung A.CS., Kwok J.T., Chan J.H., King I. (eds) Neural Information Processing. ICONIP 2020. Communications in Computer and Information Science, vol 1333. Springer, Cham | en |
dc.identifier.other | Y | |
dc.identifier.uri | http://hdl.handle.net/2262/98320 | |
dc.description.abstract | We present an approach to design the grid searches for hyper-parameter optimization for recurrent neural architectures. The basis for this approach is the use of mutual information to analyze long distance dependencies (LDDs) within a dataset. We also report a set of experiments that demonstrate how using this approach, we obtain state-of-the-art results for DilatedRNNs across a range of benchmark datasets. | en |
dc.format.extent | 616-624 | en |
dc.language.iso | en | en |
dc.relation.ispartofseries | Communications in Computer and Information Science; | |
dc.relation.ispartofseries | 1333; | |
dc.rights | Y | en |
dc.subject | benchmark datasets | en |
dc.subject | DilatedRNNs | en |
dc.subject | Long Distance Dependencies | en |
dc.subject | Recurrent neural architectures | en |
dc.subject | Hyper-parameter tuning | en |
dc.subject | Vanishing gradients | en |
dc.title | Mutual Information Decay Curves and Hyper-parameter Grid Search Design for Recurrent Neural Architectures | en |
dc.type | Conference Paper | en |
dc.type.supercollection | scholarly_publications | en |
dc.type.supercollection | refereed_publications | en |
dc.identifier.peoplefinderurl | http://people.tcd.ie/kellehjd | |
dc.identifier.rssinternalid | 224458 | |
dc.identifier.doi | http://dx.doi.org/10.1007/978-3-030-63823-8_70 | |
dc.rights.ecaccessrights | openAccess | |
dc.contributor.sponsor | Science Foundation Ireland (SFI) | en |
dc.contributor.sponsorGrantNumber | 13/ RC/2106 | en |